[ 529.189074] env[65381]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 529.189074] env[65381]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 530.210347] env[65469]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 530.210347] env[65469]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 532.041491] env[65469]: INFO neutron.common.config [-] Logging enabled! [ 532.041954] env[65469]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 532.042105] env[65469]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65469) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 532.042451] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 532.042573] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 532.043486] env[65469]: WARNING oslo_policy.policy [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.043712] env[65469]: WARNING oslo_policy.policy [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.045428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] VMware NSXv3 Agent initialized successfully. [ 532.045811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Acquiring lock "singleton_lock" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.045929] env[65469]: DEBUG oslo_concurrency.lockutils [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Acquired lock "singleton_lock" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.046149] env[65469]: DEBUG oslo_concurrency.lockutils [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Releasing lock "singleton_lock" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.046438] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Full set of CONF: {{(pid=65469) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 532.046548] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ******************************************************************************** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 532.046647] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Configuration options gathered from: {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 532.047307] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 532.047485] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 532.047672] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ================================================================================ {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 532.047751] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] agent_down_time = 75 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.047951] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] allow_automatic_dhcp_failover = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048156] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] allow_bulk = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048340] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] api_extensions_path = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048493] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] api_paste_config = api-paste.ini {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048634] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] auth_strategy = keystone {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048737] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] backdoor_port = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048839] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] backdoor_socket = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.048988] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] backlog = 4096 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049143] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049326] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] bind_host = 0.0.0.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049471] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] bind_port = 9696 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049602] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] client_socket_timeout = 900 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049739] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] config_dir = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049844] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.049977] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] config_source = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.050174] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] control_exchange = neutron {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.050326] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] core_plugin = ml2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.050519] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] debug = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.050680] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] default_availability_zones = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.050971] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.051222] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dhcp_agent_notification = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.051471] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dhcp_agents_per_network = 1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.051706] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dhcp_lease_duration = 86400 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.051910] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dhcp_load_type = networks {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.052097] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dns_domain = openstacklocal {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.052294] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.052499] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_default_route_bfd = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.052715] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_default_route_ecmp = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.052928] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_dvr = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053163] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_new_agents = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053348] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053507] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_signals = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053702] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] enable_traditional_dhcp = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053845] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] external_dns_driver = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.053980] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] filter_validation = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.054180] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] global_physnet_mtu = 8950 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.054368] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] graceful_shutdown_timeout = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.054592] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] host = cpu-1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.054749] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] host_dvr_for_dhcp = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.054913] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] http_retries = 3 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055071] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] instance_format = [instance: %(uuid)s] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055213] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055351] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ipam_driver = internal {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055481] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ipv6_pd_enabled = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055610] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] l3_ha = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055746] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.055910] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] l3_ha_network_physical_name = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056064] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] l3_ha_network_type = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056205] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_color = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056342] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_config_append = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056477] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056606] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_dir = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056736] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_file = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056839] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_options = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.056991] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_rotate_interval = 1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057153] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_rotate_interval_type = days {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057290] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] log_rotation_type = none {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057393] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057493] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057628] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057819] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057887] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.057986] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_dns_nameservers = 5 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058149] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_header_line = 16384 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058292] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_l3_agents_per_router = 3 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058422] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_logfile_count = 30 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058550] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_logfile_size_mb = 200 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058676] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] max_subnet_host_routes = 20 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058812] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] my_ip = 10.180.1.21 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.058947] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] my_ipv6 = ::1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059088] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] network_auto_schedule = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059216] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] network_link_prefix = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059390] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059551] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] notify_nova_on_port_data_changes = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059690] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] notify_nova_on_port_status_changes = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059828] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] pagination_max_limit = -1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.059959] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] publish_errors = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060107] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rate_limit_burst = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060245] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rate_limit_except_level = CRITICAL {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060376] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rate_limit_interval = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060500] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] retry_until_window = 30 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060625] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] router_distributed = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060751] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rpc_resources_processing_step = 20 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.060879] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rpc_response_max_timeout = 600 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061052] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] rpc_response_timeout = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061211] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] send_events_interval = 2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061366] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] service_plugins = ['router'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061507] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] setproctitle = on {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061636] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] shell_completion = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061772] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] state_path = /opt/stack/data/neutron {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.061913] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] syslog_log_facility = LOG_USER {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062065] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] tcp_keepidle = 600 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062205] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] transport_url = **** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062336] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] use_journal = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062464] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] use_json = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062593] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] use_ssl = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062723] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] use_stderr = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062862] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] use_syslog = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.062990] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vlan_qinq = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063130] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vlan_transparent = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063260] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] watch_log_file = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063391] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] wsgi_default_pool_size = 100 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063520] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] wsgi_keep_alive = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063659] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063836] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] wsgi_server_debug = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.063993] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_concurrency.disable_process_locking = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064151] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064318] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064465] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064607] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064748] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.064910] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065099] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.connection_string = messaging:// {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065245] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.enabled = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065418] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.es_doc_type = notification {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065525] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.es_scroll_size = 10000 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065665] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.es_scroll_time = 2m {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065832] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.filter_error_trace = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.065972] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.hmac_keys = **** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066160] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.sentinel_service_name = mymaster {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066349] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.socket_timeout = 0.1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066505] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.trace_requests = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066643] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler.trace_sqlalchemy = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066793] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler_jaeger.process_tags = {} {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.066929] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler_jaeger.service_name_prefix = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.067074] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] profiler_otlp.service_name_prefix = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.067223] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.enforce_new_defaults = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.067493] env[65469]: WARNING oslo_config.cfg [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 532.067645] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.enforce_scope = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.067789] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.policy_default_rule = default {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.067935] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068088] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068232] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068365] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068526] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068674] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068811] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.068965] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069140] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069288] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] agent.extensions = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069450] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069607] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] service_providers.service_provider = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069754] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.default_quota = -1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.069900] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070046] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_floatingip = 50 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070184] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_network = 100 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070319] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_port = 500 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070451] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070584] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_router = 10 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070714] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_security_group = 10 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070847] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.070981] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.quota_subnet = 100 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071126] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] QUOTAS.track_quota_usage = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071271] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071403] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071533] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071667] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071806] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.071942] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072088] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072231] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072360] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072488] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072619] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072755] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.072887] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073068] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_dhcp_release.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073220] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073352] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073480] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073611] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073750] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.073928] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074093] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_ovs_vsctl.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074237] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.capabilities = [21] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074365] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074496] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074628] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074765] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.074901] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075076] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_namespace.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075226] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.capabilities = [12] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075357] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075485] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075616] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075751] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.075912] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076058] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_conntrack.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076200] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.capabilities = [12, 21] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076328] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.group = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076453] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.helper_command = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076583] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.log_daemon_traceback = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076720] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.076857] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.thread_pool_size = 8 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077033] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] privsep_link.user = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077235] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077390] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077529] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.continue_on_failed_promotions = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077663] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.dscp = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077800] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.dscp_inherit = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.077941] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.force_mp_to_policy = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078092] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.locking_coordinator_url = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078256] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.log_agent_heartbeats = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078394] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.logging_expire = 1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078535] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078672] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078815] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.polling_interval = 240 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.078954] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079106] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079249] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.report_interval = 30.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079391] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079556] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079711] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079851] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.sync_skew = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.079988] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.synchronization_queue_size = 20 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080141] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT.use_helper_for_ns_read = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080281] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] SECURITYGROUP.enable_ipset = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080423] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] SECURITYGROUP.enable_security_group = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080565] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080707] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.080845] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] experimental.ipv6_pd_enabled = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081027] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.extension_drivers = ['port_security'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081171] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.external_network_type = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081322] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081464] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.overlay_ip_version = 4 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081601] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.path_mtu = 8950 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081738] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.physical_network_mtus = {} {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.081881] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082033] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082245] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ml2.type_drivers = ['vlan'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082319] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082448] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082579] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082723] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.082864] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083020] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083157] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083297] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083442] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083636] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083809] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_login_password = **** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083988] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084198] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_login_user = admin {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084403] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084564] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084704] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084843] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085010] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085193] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085339] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085478] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085614] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085811] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085967] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086165] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086320] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086529] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086682] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086823] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086962] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087171] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.auth_section = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087335] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.auth_type = password {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087478] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087611] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.certfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087748] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.collect_timing = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087892] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.endpoint_type = public {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088039] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.insecure = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088174] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.keyfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088316] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.region_name = RegionOne {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088451] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.split_loggers = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088581] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] nova.timeout = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088719] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.auth_section = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088862] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.auth_type = password {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089031] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089170] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.certfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089305] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.collect_timing = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089447] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.endpoint_type = public {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089586] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.insecure = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089742] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.keyfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089875] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.region_name = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090019] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.split_loggers = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090155] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] placement.timeout = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090292] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.auth_section = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090429] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.auth_type = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090561] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.cafile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090691] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.certfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090856] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.collect_timing = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090958] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.connect_retries = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091100] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.connect_retry_delay = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091233] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.enable_notifications = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091360] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.endpoint_override = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091494] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.insecure = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091624] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.interface = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091777] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.keyfile = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091965] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.max_version = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092141] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.min_version = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092324] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.region_name = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092467] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.retriable_status_codes = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092602] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.service_name = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092735] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.service_type = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092869] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.split_loggers = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093033] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.status_code_retries = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093176] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.status_code_retry_delay = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093308] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.timeout = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093440] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.valid_interfaces = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093572] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ironic.version = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093711] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] cli_script.dry_run = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093855] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093989] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094139] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094274] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094458] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094612] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094746] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094881] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095027] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095202] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095351] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095496] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095695] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095879] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096027] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096206] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096359] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096495] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096635] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096771] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096912] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097068] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097206] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097342] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097477] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097611] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097742] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097873] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098070] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098265] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098366] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098528] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098674] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098812] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098957] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099112] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099250] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099392] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_notifications.driver = [] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099526] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_notifications.retry = -1 {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099685] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099844] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099950] env[65469]: DEBUG oslo_service.backend._eventlet.service [None req-747a03e1-13ca-4f7c-9cd9-ec4e96018b18 None None] ******************************************************************************** {{(pid=65469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 532.101095] env[65469]: DEBUG neutron.agent.securitygroups_rpc [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Init firewall settings (driver=nsxv3) {{(pid=65469) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 532.102402] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65469) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 532.102640] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] RPC agent_id: nsxm-l-01a.corp.local [ 532.104996] env[65469]: DEBUG dogpile.cache.region [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.105183] env[65469]: DEBUG dogpile.lock [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 532.105316] env[65469]: DEBUG dogpile.lock [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 532.105415] env[65469]: DEBUG dogpile.lock [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 532.105511] env[65469]: DEBUG dogpile.cache.region [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.105599] env[65469]: DEBUG dogpile.lock [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 532.105723] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 532.135325] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Session token - acquiring [ 532.136898] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.137090] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.137211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.137610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.147570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.423016] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 532.445067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 532.445233] env[65469]: DEBUG dogpile.cache.region [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Cache value generated in 0.339 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 532.445393] env[65469]: DEBUG dogpile.lock [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 532.445457] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Activating Policy API Provider. [ 532.445632] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Looking for the default Infrastructure Rules. [ 532.508969] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Looking for the Default Layer3 Logged Drop Section. [ 532.522678] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 532.523143] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.523341] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.523407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.523753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.524143] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.039016] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.541148] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.043594] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Inventory metadata is going to be refreshed. [ 534.043915] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 534.816017] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.816534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.816534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.816682] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.827318] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 534.828235] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.829135] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 534.847544] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.847790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.847837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.848213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.848391] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.848546] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 534.848662] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.848765] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 534.868810] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.869075] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.869075] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.869369] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.869536] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.869683] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 534.891943] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.892176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.892246] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.892502] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.892644] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.892785] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 534.913452] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.913687] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.913732] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.913995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.914145] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.914293] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 534.914389] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.914491] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 534.941748] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.941974] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.942036] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.942337] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.942464] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.942607] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 534.942739] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.942848] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 534.961806] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.962085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.962085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.962465] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.962572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.962709] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 534.962770] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.962872] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Inventory metadata have been refreshed. [ 534.962967] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Dryrun:True. Metadata refresh completed. [ 534.963094] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.965075] env[65469]: INFO neutron.agent.agent_extensions_manager [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Loaded agent extensions: [] [ 534.965846] env[65469]: DEBUG neutron_lib.callbacks.manager [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65469) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 535.024784] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent RPC Daemon Started! [ 535.024987] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:0 started [ 535.024987] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent out of sync with plugin! [ 539.966468] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.966826] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.968161] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.968548] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.969610] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.969610] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.973452] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c21e2d91-5c23-4acb-83d6-84275dc1e8e6 demo admin] Enqueued Resource ID: c2b7c500-65a1-4270-ad75-5a5d3613d5e1 with Priority: HIGHEST for action security_group_rules [ 549.974039] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b7c500-65a1-4270-ad75-5a5d3613d5e1 with Priority: HIGHEST for action security_group_rules [ 549.974257] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2b7c500-65a1-4270-ad75-5a5d3613d5e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.974541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2b7c500-65a1-4270-ad75-5a5d3613d5e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.975584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2b7c500-65a1-4270-ad75-5a5d3613d5e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.975584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2b7c500-65a1-4270-ad75-5a5d3613d5e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.975584] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2b7c500-65a1-4270-ad75-5a5d3613d5e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.495754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.495972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.495972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.496260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.496353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.496450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2b7c500-65a1-4270-ad75-5a5d3613d5e1 already deleted. [ 550.496531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2b7c500-65a1-4270-ad75-5a5d3613d5e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.975286] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.975286] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.976138] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.976872] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.977958] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 564.978675] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.979608] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.979964] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.980390] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.980390] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 577.969074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.969368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.969368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.969511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.969734] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.472221] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.974333] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.476821] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 579.476949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 579.981174] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.981174] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.127054] env[65469]: INFO networking_nsxv3.common.synchronization [None req-81d83dc4-5106-475c-86cd-485bd738c81a None None] Enqueued Resource ID: 49dc78a4-726d-4b0f-9c96-faf8e62d93ff with Priority: HIGHEST for action port [ 580.129719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dc78a4-726d-4b0f-9c96-faf8e62d93ff with Priority: HIGHEST for action port [ 580.134575] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-49dc78a4-726d-4b0f-9c96-faf8e62d93ff taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.134749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49dc78a4-726d-4b0f-9c96-faf8e62d93ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.134784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49dc78a4-726d-4b0f-9c96-faf8e62d93ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.135227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49dc78a4-726d-4b0f-9c96-faf8e62d93ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.135315] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49dc78a4-726d-4b0f-9c96-faf8e62d93ff',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.269885] env[65469]: INFO networking_nsxv3.common.synchronization [None req-673dca52-12d0-46c0-9246-11f36ba30d42 None None] Enqueued Resource ID: ceef10e6-0b96-4291-bca4-46ef31dc2894 with Priority: HIGHEST for action port [ 580.274940] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceef10e6-0b96-4291-bca4-46ef31dc2894 with Priority: HIGHEST for action port [ 580.275405] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceef10e6-0b96-4291-bca4-46ef31dc2894 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.275944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceef10e6-0b96-4291-bca4-46ef31dc2894" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.275944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceef10e6-0b96-4291-bca4-46ef31dc2894" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.276202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceef10e6-0b96-4291-bca4-46ef31dc2894" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.276314] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceef10e6-0b96-4291-bca4-46ef31dc2894',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.336636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.337136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.337136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.337136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.351343] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 580.355546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.355546] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 580.374099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.374285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.374324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.374525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.374611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.374719] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 580.374791] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.375046] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 580.427073] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.427073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.427073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.427073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.427073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.427073] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 580.448971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.449187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.449253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.449413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.449514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.449628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 580.468957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.469125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.469195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.469400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.469506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.469627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 580.469702] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.469771] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 580.487838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.488072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.488072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.488286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.488374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.488486] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 580.488559] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.488629] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 580.512514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.512514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.512514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.512514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.512514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 580.512514] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 580.512514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 580.513124] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 580.538734] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.540179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.540179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.540179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.540179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.540179] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 580.562614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.562835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.562891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.563604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.563604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.580352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.638793] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49dc78a4-726d-4b0f-9c96-faf8e62d93ff [ 580.639040] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.639193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.639261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.639474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.640058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.641302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49dc78a4-726d-4b0f-9c96-faf8e62d93ff already deleted. [ 580.641302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49dc78a4-726d-4b0f-9c96-faf8e62d93ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.781024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ceef10e6-0b96-4291-bca4-46ef31dc2894 [ 580.781024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.781024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.781024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.781024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.781024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.781024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ceef10e6-0b96-4291-bca4-46ef31dc2894 already deleted. [ 580.781024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceef10e6-0b96-4291-bca4-46ef31dc2894" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.881553] env[65469]: INFO networking_nsxv3.common.synchronization [None req-5a4354af-9c23-4c37-b0ff-a9870962f059 None None] Enqueued Resource ID: 46768c76-d168-4a19-b4d8-5c648786c99f with Priority: HIGHEST for action port [ 581.883189] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46768c76-d168-4a19-b4d8-5c648786c99f with Priority: HIGHEST for action port [ 581.883189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-46768c76-d168-4a19-b4d8-5c648786c99f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.883189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46768c76-d168-4a19-b4d8-5c648786c99f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.883189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46768c76-d168-4a19-b4d8-5c648786c99f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.893737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46768c76-d168-4a19-b4d8-5c648786c99f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.894126] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46768c76-d168-4a19-b4d8-5c648786c99f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.402100] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46768c76-d168-4a19-b4d8-5c648786c99f [ 582.402100] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.402465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.402465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.402561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.402656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.402755] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46768c76-d168-4a19-b4d8-5c648786c99f already deleted. [ 582.402837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46768c76-d168-4a19-b4d8-5c648786c99f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.503967] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ce1b6710-379f-4027-ad5a-c723730eb460 None None] Enqueued Resource ID: 54fdbf3c-d2d5-49e3-904d-f89493304278 with Priority: HIGHEST for action port [ 582.504641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fdbf3c-d2d5-49e3-904d-f89493304278 with Priority: HIGHEST for action port [ 582.504987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-54fdbf3c-d2d5-49e3-904d-f89493304278 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.506017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54fdbf3c-d2d5-49e3-904d-f89493304278" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.506289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54fdbf3c-d2d5-49e3-904d-f89493304278" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.506377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54fdbf3c-d2d5-49e3-904d-f89493304278" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.506465] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54fdbf3c-d2d5-49e3-904d-f89493304278',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.013133] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54fdbf3c-d2d5-49e3-904d-f89493304278 [ 583.014064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.014303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.014413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.014642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.014740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.014841] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54fdbf3c-d2d5-49e3-904d-f89493304278 already deleted. [ 583.014965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54fdbf3c-d2d5-49e3-904d-f89493304278" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.607482] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e30f083e-1d81-49ab-9222-5cda5b5cb408 None None] Enqueued Resource ID: dc8b1947-5b44-47f2-9e98-d2e75f61d0e8 with Priority: HIGHEST for action port [ 583.608161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8b1947-5b44-47f2-9e98-d2e75f61d0e8 with Priority: HIGHEST for action port [ 583.608562] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8b1947-5b44-47f2-9e98-d2e75f61d0e8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.608662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8b1947-5b44-47f2-9e98-d2e75f61d0e8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.608662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8b1947-5b44-47f2-9e98-d2e75f61d0e8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.608914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8b1947-5b44-47f2-9e98-d2e75f61d0e8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.608999] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8b1947-5b44-47f2-9e98-d2e75f61d0e8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.047676] env[65469]: INFO networking_nsxv3.common.synchronization [None req-62f311ca-a11c-4e92-aa22-711822d198f9 None None] Enqueued Resource ID: 513d2e5a-c622-46a4-8f41-c990a22044e1 with Priority: HIGHEST for action port [ 584.048622] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513d2e5a-c622-46a4-8f41-c990a22044e1 with Priority: HIGHEST for action port [ 584.048622] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-513d2e5a-c622-46a4-8f41-c990a22044e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.050758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-513d2e5a-c622-46a4-8f41-c990a22044e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.050758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-513d2e5a-c622-46a4-8f41-c990a22044e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.050867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-513d2e5a-c622-46a4-8f41-c990a22044e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.050945] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513d2e5a-c622-46a4-8f41-c990a22044e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.112419] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc8b1947-5b44-47f2-9e98-d2e75f61d0e8 [ 584.112675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.112810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.112877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.113116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.113205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.113299] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc8b1947-5b44-47f2-9e98-d2e75f61d0e8 already deleted. [ 584.113378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8b1947-5b44-47f2-9e98-d2e75f61d0e8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.554414] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 513d2e5a-c622-46a4-8f41-c990a22044e1 [ 584.554681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.554860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.554923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.555217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.555306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.555410] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:513d2e5a-c622-46a4-8f41-c990a22044e1 already deleted. [ 584.555496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-513d2e5a-c622-46a4-8f41-c990a22044e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.961538] env[65469]: INFO networking_nsxv3.common.synchronization [None req-900f2204-2869-45a0-84ed-06ac14620910 None None] Enqueued Resource ID: 8ce529cb-7aaa-407d-a6e0-eae8f93c46fa with Priority: HIGHEST for action port [ 585.962185] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ce529cb-7aaa-407d-a6e0-eae8f93c46fa with Priority: HIGHEST for action port [ 585.962284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ce529cb-7aaa-407d-a6e0-eae8f93c46fa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.962346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ce529cb-7aaa-407d-a6e0-eae8f93c46fa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.962381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ce529cb-7aaa-407d-a6e0-eae8f93c46fa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.962714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ce529cb-7aaa-407d-a6e0-eae8f93c46fa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.962896] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce529cb-7aaa-407d-a6e0-eae8f93c46fa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.992043] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e236dbf1-ebda-4eff-a3b4-79ddcb2adea3 None None] Enqueued Resource ID: ee8ce33b-becd-4a1f-a686-eac2cac5b102 with Priority: HIGHEST for action port [ 585.992043] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8ce33b-becd-4a1f-a686-eac2cac5b102 with Priority: HIGHEST for action port [ 585.992043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee8ce33b-becd-4a1f-a686-eac2cac5b102 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.992043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee8ce33b-becd-4a1f-a686-eac2cac5b102" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.992043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee8ce33b-becd-4a1f-a686-eac2cac5b102" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.992043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee8ce33b-becd-4a1f-a686-eac2cac5b102" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.992646] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee8ce33b-becd-4a1f-a686-eac2cac5b102',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.467822] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ce529cb-7aaa-407d-a6e0-eae8f93c46fa [ 586.468196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.468340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.468410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.468622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.469874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.469874] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ce529cb-7aaa-407d-a6e0-eae8f93c46fa already deleted. [ 586.469874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ce529cb-7aaa-407d-a6e0-eae8f93c46fa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.496459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee8ce33b-becd-4a1f-a686-eac2cac5b102 [ 586.496638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.497292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.497292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.497292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.497292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.497292] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee8ce33b-becd-4a1f-a686-eac2cac5b102 already deleted. [ 586.497292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee8ce33b-becd-4a1f-a686-eac2cac5b102" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.920618] env[65469]: INFO networking_nsxv3.common.synchronization [None req-23a5f8c5-502f-44a8-b628-efdaac42a075 None None] Enqueued Resource ID: 9e0acfcf-e979-4cbd-a136-b9828e47e7df with Priority: HIGHEST for action port [ 588.920618] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0acfcf-e979-4cbd-a136-b9828e47e7df with Priority: HIGHEST for action port [ 588.920618] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e0acfcf-e979-4cbd-a136-b9828e47e7df taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.921099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e0acfcf-e979-4cbd-a136-b9828e47e7df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.921316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e0acfcf-e979-4cbd-a136-b9828e47e7df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.921653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e0acfcf-e979-4cbd-a136-b9828e47e7df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.922122] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e0acfcf-e979-4cbd-a136-b9828e47e7df',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.959187] env[65469]: INFO networking_nsxv3.common.synchronization [None req-153a831e-4a4c-424f-a6d9-e2fcefd7d067 None None] Enqueued Resource ID: ab150460-cb5b-4ab1-b801-cc16266e9ae1 with Priority: HIGHEST for action port [ 588.959187] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab150460-cb5b-4ab1-b801-cc16266e9ae1 with Priority: HIGHEST for action port [ 588.959324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab150460-cb5b-4ab1-b801-cc16266e9ae1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.959324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab150460-cb5b-4ab1-b801-cc16266e9ae1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.959422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab150460-cb5b-4ab1-b801-cc16266e9ae1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.959910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab150460-cb5b-4ab1-b801-cc16266e9ae1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.959910] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab150460-cb5b-4ab1-b801-cc16266e9ae1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.227836] env[65469]: INFO networking_nsxv3.common.synchronization [None req-f0b48d83-40c7-4a68-a3ad-2799ef7fe5af None None] Enqueued Resource ID: 473cdea5-fa61-4ff8-8487-4d49d6b1976d with Priority: HIGHEST for action port [ 589.227836] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473cdea5-fa61-4ff8-8487-4d49d6b1976d with Priority: HIGHEST for action port [ 589.227836] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-473cdea5-fa61-4ff8-8487-4d49d6b1976d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.227836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473cdea5-fa61-4ff8-8487-4d49d6b1976d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.227836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473cdea5-fa61-4ff8-8487-4d49d6b1976d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.227836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473cdea5-fa61-4ff8-8487-4d49d6b1976d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.227836] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473cdea5-fa61-4ff8-8487-4d49d6b1976d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.426464] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e0acfcf-e979-4cbd-a136-b9828e47e7df [ 589.426795] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.426898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.426978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.427261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.427375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.428467] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e0acfcf-e979-4cbd-a136-b9828e47e7df already deleted. [ 589.428467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e0acfcf-e979-4cbd-a136-b9828e47e7df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.461943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab150460-cb5b-4ab1-b801-cc16266e9ae1 [ 589.462885] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.463848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.463925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.464401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.464611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.465319] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab150460-cb5b-4ab1-b801-cc16266e9ae1 already deleted. [ 589.465319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab150460-cb5b-4ab1-b801-cc16266e9ae1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.730289] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 473cdea5-fa61-4ff8-8487-4d49d6b1976d [ 589.730551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.730694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.730765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.731013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.731108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.731225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:473cdea5-fa61-4ff8-8487-4d49d6b1976d already deleted. [ 589.731309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473cdea5-fa61-4ff8-8487-4d49d6b1976d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.782483] env[65469]: INFO networking_nsxv3.common.synchronization [None req-0d3f841e-5caf-4441-b39d-ed2c6385fef6 None None] Enqueued Resource ID: 6514dc23-c566-4dd2-80fc-c3e20bda63df with Priority: HIGHEST for action port [ 589.783069] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6514dc23-c566-4dd2-80fc-c3e20bda63df with Priority: HIGHEST for action port [ 589.783447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6514dc23-c566-4dd2-80fc-c3e20bda63df taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.783579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6514dc23-c566-4dd2-80fc-c3e20bda63df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.783579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6514dc23-c566-4dd2-80fc-c3e20bda63df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.783846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6514dc23-c566-4dd2-80fc-c3e20bda63df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.783924] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6514dc23-c566-4dd2-80fc-c3e20bda63df',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.287928] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6514dc23-c566-4dd2-80fc-c3e20bda63df [ 590.287928] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.288261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.288261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.288327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.288698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.288698] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6514dc23-c566-4dd2-80fc-c3e20bda63df already deleted. [ 590.288698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6514dc23-c566-4dd2-80fc-c3e20bda63df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.626253] env[65469]: INFO networking_nsxv3.common.synchronization [None req-75b3e995-c4cb-406a-9dee-688bf4d8c6b7 None None] Enqueued Resource ID: e6f3787d-c615-430e-97f7-e6fc5f85c977 with Priority: HIGHEST for action port [ 592.626698] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6f3787d-c615-430e-97f7-e6fc5f85c977 with Priority: HIGHEST for action port [ 592.627949] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6f3787d-c615-430e-97f7-e6fc5f85c977 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.627949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6f3787d-c615-430e-97f7-e6fc5f85c977" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.627949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6f3787d-c615-430e-97f7-e6fc5f85c977" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.627949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6f3787d-c615-430e-97f7-e6fc5f85c977" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.627949] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f3787d-c615-430e-97f7-e6fc5f85c977',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.129963] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6f3787d-c615-430e-97f7-e6fc5f85c977 [ 593.130221] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.130357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.130417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.130640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.130730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.132314] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6f3787d-c615-430e-97f7-e6fc5f85c977 already deleted. [ 593.132314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6f3787d-c615-430e-97f7-e6fc5f85c977" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.547230] env[65469]: INFO networking_nsxv3.common.synchronization [None req-abcedd96-572c-4714-a33b-4fcdbd891484 None None] Enqueued Resource ID: f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e with Priority: HIGHEST for action port [ 593.547230] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e with Priority: HIGHEST for action port [ 593.547230] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.547230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.548071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.548868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.548868] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.954257] env[65469]: INFO networking_nsxv3.common.synchronization [None req-68ca15b8-5c04-46a5-be65-d6a87fce3a99 None None] Enqueued Resource ID: 254708f1-1bce-4687-b2b7-93f12b7273df with Priority: HIGHEST for action port [ 593.955662] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 254708f1-1bce-4687-b2b7-93f12b7273df with Priority: HIGHEST for action port [ 593.957783] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-254708f1-1bce-4687-b2b7-93f12b7273df taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.957783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-254708f1-1bce-4687-b2b7-93f12b7273df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.958213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-254708f1-1bce-4687-b2b7-93f12b7273df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.958351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-254708f1-1bce-4687-b2b7-93f12b7273df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.958465] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('254708f1-1bce-4687-b2b7-93f12b7273df',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.050657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e [ 594.050657] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.050823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.050892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.052019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.052019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.052019] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e already deleted. [ 594.052019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f69bb1b8-00c4-47e1-96c7-8e9fd63f9b7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.461548] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 254708f1-1bce-4687-b2b7-93f12b7273df [ 594.461548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.461698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.461698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.461913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.462052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.462187] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:254708f1-1bce-4687-b2b7-93f12b7273df already deleted. [ 594.462274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-254708f1-1bce-4687-b2b7-93f12b7273df" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.710388] env[65469]: INFO networking_nsxv3.common.synchronization [None req-243e8d63-eb06-42f6-b716-7e8c331e5206 None None] Enqueued Resource ID: 6c5382eb-2081-4c56-95aa-7d3f19724661 with Priority: HIGHEST for action port [ 594.710388] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c5382eb-2081-4c56-95aa-7d3f19724661 with Priority: HIGHEST for action port [ 594.710388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c5382eb-2081-4c56-95aa-7d3f19724661 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.710388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c5382eb-2081-4c56-95aa-7d3f19724661" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.710388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c5382eb-2081-4c56-95aa-7d3f19724661" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.711095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c5382eb-2081-4c56-95aa-7d3f19724661" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.711372] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c5382eb-2081-4c56-95aa-7d3f19724661',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.215682] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c5382eb-2081-4c56-95aa-7d3f19724661 [ 595.216173] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.216173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.216173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.216344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.216373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.216490] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c5382eb-2081-4c56-95aa-7d3f19724661 already deleted. [ 595.216535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c5382eb-2081-4c56-95aa-7d3f19724661" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.243096] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8dfda2c4-41bb-440f-a0b1-c2acc8f1fe77 None None] Enqueued Resource ID: c2dfe2ae-dd43-4335-9d78-5d0bb4249062 with Priority: HIGHEST for action port [ 596.243382] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2dfe2ae-dd43-4335-9d78-5d0bb4249062 with Priority: HIGHEST for action port [ 596.244577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2dfe2ae-dd43-4335-9d78-5d0bb4249062 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.244577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2dfe2ae-dd43-4335-9d78-5d0bb4249062" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.244577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2dfe2ae-dd43-4335-9d78-5d0bb4249062" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.244577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2dfe2ae-dd43-4335-9d78-5d0bb4249062" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.244577] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2dfe2ae-dd43-4335-9d78-5d0bb4249062',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.471799] env[65469]: INFO networking_nsxv3.common.synchronization [None req-1cf889e0-2ea1-46c4-a236-1b85c46e90f1 None None] Enqueued Resource ID: 904b1d80-c72e-4d70-bddd-a14407146a4c with Priority: HIGHEST for action port [ 596.472051] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 904b1d80-c72e-4d70-bddd-a14407146a4c with Priority: HIGHEST for action port [ 596.472593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-904b1d80-c72e-4d70-bddd-a14407146a4c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.472713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-904b1d80-c72e-4d70-bddd-a14407146a4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.472777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-904b1d80-c72e-4d70-bddd-a14407146a4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.473029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-904b1d80-c72e-4d70-bddd-a14407146a4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.473104] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('904b1d80-c72e-4d70-bddd-a14407146a4c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.748385] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2dfe2ae-dd43-4335-9d78-5d0bb4249062 [ 596.748894] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.748894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.748894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.750149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.750259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.750392] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2dfe2ae-dd43-4335-9d78-5d0bb4249062 already deleted. [ 596.750446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2dfe2ae-dd43-4335-9d78-5d0bb4249062" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.975196] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 904b1d80-c72e-4d70-bddd-a14407146a4c [ 596.977508] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.977508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.977508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.977508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.977508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.977508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:904b1d80-c72e-4d70-bddd-a14407146a4c already deleted. [ 596.977508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-904b1d80-c72e-4d70-bddd-a14407146a4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.045240] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4f133eaf-ce01-4e33-ae7d-4ff8bef03a63 tempest-VolumesAssistedSnapshotsTest-325735266 tempest-VolumesAssistedSnapshotsTest-325735266-project-member] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 597.045755] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 597.046092] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.046928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.046928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.047036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.047119] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.466201] env[65469]: INFO networking_nsxv3.common.synchronization [req-b4d779f6-7536-494e-91e1-d7600ff7e354 req-7e9a6881-6d5d-431a-afbd-c78a27b9baf3 tempest-TenantUsagesTestJSON-1997812009 tempest-TenantUsagesTestJSON-1997812009-project-member] Enqueued Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 597.466756] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 597.467226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.467358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.467358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.467591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.468024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.468024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.468024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.469430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.469597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.469907] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.566965] env[65469]: INFO networking_nsxv3.common.synchronization [None req-fa6cf3d2-35f1-4e53-ad8b-4f4ae49ceee1 None None] Enqueued Resource ID: 1a1ed77a-f9e3-4804-a018-ad840dd6ed13 with Priority: HIGHEST for action port [ 597.568512] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.568742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.568830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.569085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.569149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.569231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 already deleted. [ 597.569314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.569779] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1ed77a-f9e3-4804-a018-ad840dd6ed13 with Priority: HIGHEST for action port [ 597.570257] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1ed77a-f9e3-4804-a018-ad840dd6ed13 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.570257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1ed77a-f9e3-4804-a018-ad840dd6ed13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.570257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1ed77a-f9e3-4804-a018-ad840dd6ed13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.570467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1ed77a-f9e3-4804-a018-ad840dd6ed13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.570507] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1ed77a-f9e3-4804-a018-ad840dd6ed13',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.973380] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.973380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.973380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.973380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.973380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.973589] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.973589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.973679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.974278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.974278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.974278] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 already deleted. [ 597.974278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.074599] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a1ed77a-f9e3-4804-a018-ad840dd6ed13 [ 598.074841] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.074981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.075072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.075284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.075373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.075469] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a1ed77a-f9e3-4804-a018-ad840dd6ed13 already deleted. [ 598.075551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1ed77a-f9e3-4804-a018-ad840dd6ed13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.304325] env[65469]: INFO networking_nsxv3.common.synchronization [None req-411f800d-0461-418c-baa6-ac019bf0466c tempest-VolumesAssistedSnapshotsTest-325735266 tempest-VolumesAssistedSnapshotsTest-325735266-project-member] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 598.304935] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 598.305352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.305469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.305513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.305685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.305764] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.746820] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f90d003-df2b-4e55-bcfb-c44b8a67fabc req-34650282-06d4-41bd-85b4-1cb9f5607338 tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 598.747416] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 598.747746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.747865] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.747947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.748230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.748382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.748496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.748561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.748733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.748821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.748924] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.813092] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8938988b-c96d-4f94-8e9d-052614b83685 None None] Enqueued Resource ID: 2b61ca99-266e-4999-bf9c-b5290221044c with Priority: HIGHEST for action port [ 598.817174] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b61ca99-266e-4999-bf9c-b5290221044c with Priority: HIGHEST for action port [ 598.818744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b61ca99-266e-4999-bf9c-b5290221044c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.819273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b61ca99-266e-4999-bf9c-b5290221044c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.819273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b61ca99-266e-4999-bf9c-b5290221044c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.819452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b61ca99-266e-4999-bf9c-b5290221044c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.819500] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b61ca99-266e-4999-bf9c-b5290221044c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.833150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.833990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.834871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.835186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.835287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.835392] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 already deleted. [ 598.835475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.940317] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9af5ecd4-3e53-4182-b6a6-ff2b7e7a4f20 None None] Enqueued Resource ID: 5ba4c711-5ce2-4c18-97f4-6943de2f7d8d with Priority: HIGHEST for action port [ 598.940317] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ba4c711-5ce2-4c18-97f4-6943de2f7d8d with Priority: HIGHEST for action port [ 598.940317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ba4c711-5ce2-4c18-97f4-6943de2f7d8d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.940317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ba4c711-5ce2-4c18-97f4-6943de2f7d8d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.940317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ba4c711-5ce2-4c18-97f4-6943de2f7d8d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.940317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ba4c711-5ce2-4c18-97f4-6943de2f7d8d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.940317] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ba4c711-5ce2-4c18-97f4-6943de2f7d8d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.256399] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.256399] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.256399] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d already deleted. [ 599.256399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.324018] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b61ca99-266e-4999-bf9c-b5290221044c [ 599.324018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.324018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.324018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.324018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.324018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.324018] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b61ca99-266e-4999-bf9c-b5290221044c already deleted. [ 599.324018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b61ca99-266e-4999-bf9c-b5290221044c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.443118] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ba4c711-5ce2-4c18-97f4-6943de2f7d8d [ 599.443342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.443469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.443534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.443745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.443874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.444030] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ba4c711-5ce2-4c18-97f4-6943de2f7d8d already deleted. [ 599.444162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ba4c711-5ce2-4c18-97f4-6943de2f7d8d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.552783] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4ff641c1-5dbd-4e65-993b-fa29732d2bb9 None None] Enqueued Resource ID: ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e with Priority: HIGHEST for action port [ 599.553558] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e with Priority: HIGHEST for action port [ 599.553656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.554200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.554200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.554200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.554200] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.609569] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.609813] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.609885] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.611919] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.612243] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.612424] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.612541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.612802] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.613200] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.613744] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.613861] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.613967] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.614082] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.614197] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.614309] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.614439] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.636796] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.636977] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.637131] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.637306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.637614] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.637787] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.637928] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.638268] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.638403] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bf6d53-fdac-41a7-b276-24cb1179bb0e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.056400] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e [ 600.056673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.056786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.056857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.057084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.057175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.057268] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e already deleted. [ 600.057348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec3dbb85-2ec7-44a8-aca9-3ce873fbe13e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.141151] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.141434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.141563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.141851] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.142014] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.142169] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port f2bf6d53-fdac-41a7-b276-24cb1179bb0e not found, creating... [ 600.142446] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.142601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.142725] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.143028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.143243] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.143786] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.144055] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.144259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.144633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.144837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.145082] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: f2bf6d53-fdac-41a7-b276-24cb1179bb0e is going to be created. [ 600.173801] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.173921] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.174042] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.174337] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.174563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.174858] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.039391] env[65469]: INFO networking_nsxv3.common.synchronization [req-b4d779f6-7536-494e-91e1-d7600ff7e354 req-16475639-e9de-4989-a252-a21022c89f9b service nova] Enqueued Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_rules [ 601.039391] env[65469]: INFO networking_nsxv3.common.synchronization [req-b4d779f6-7536-494e-91e1-d7600ff7e354 req-16475639-e9de-4989-a252-a21022c89f9b service nova] Enqueued Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 601.039486] env[65469]: INFO networking_nsxv3.common.synchronization [req-b4d779f6-7536-494e-91e1-d7600ff7e354 req-16475639-e9de-4989-a252-a21022c89f9b service nova] Enqueued Resource ID: f2bf6d53-fdac-41a7-b276-24cb1179bb0e with Priority: HIGHEST for action port [ 601.039726] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_rules [ 601.039870] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 601.040529] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2bf6d53-fdac-41a7-b276-24cb1179bb0e with Priority: HIGHEST for action port [ 601.041279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.041822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.042859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.043156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.043281] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.045223] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.045223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.045326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.046097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.046097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.046097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.046097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.046097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.046097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.046097] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.047242] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.047342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.047409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.047549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.047628] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bf6d53-fdac-41a7-b276-24cb1179bb0e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.062821] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.063177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.063225] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.064111] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.064111] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.064111] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.064111] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.064315] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.064406] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.064550] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.064680] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.064905] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.064905] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.065049] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.065115] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.065232] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.085971] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.085971] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.086180] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.086485] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.086613] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-d39bbeb8-501f-4557-9323-b4ab6b11d608 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.086820] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.086984] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.087306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.087444] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bbeb8-501f-4557-9323-b4ab6b11d608',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.247250] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7ebdc1d9-14c1-4b1d-a96c-4bc2878a31ed None None] Enqueued Resource ID: 8476d187-425b-4d30-837a-0c5ec5f79c7d with Priority: HIGHEST for action port [ 601.247250] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8476d187-425b-4d30-837a-0c5ec5f79c7d with Priority: HIGHEST for action port [ 601.247250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8476d187-425b-4d30-837a-0c5ec5f79c7d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.247250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8476d187-425b-4d30-837a-0c5ec5f79c7d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.247250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8476d187-425b-4d30-837a-0c5ec5f79c7d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.247250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8476d187-425b-4d30-837a-0c5ec5f79c7d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.247250] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8476d187-425b-4d30-837a-0c5ec5f79c7d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.420355] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d6513ac1-2b08-4d49-b2c5-75b1656ed823 None None] Enqueued Resource ID: 910d8f5e-b96b-481f-9401-addccdb1657a with Priority: HIGHEST for action port [ 601.420964] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910d8f5e-b96b-481f-9401-addccdb1657a with Priority: HIGHEST for action port [ 601.421356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-910d8f5e-b96b-481f-9401-addccdb1657a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.421356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-910d8f5e-b96b-481f-9401-addccdb1657a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.421356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-910d8f5e-b96b-481f-9401-addccdb1657a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.421580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-910d8f5e-b96b-481f-9401-addccdb1657a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.421658] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('910d8f5e-b96b-481f-9401-addccdb1657a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.551436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.551436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.569206] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2bf6d53-fdac-41a7-b276-24cb1179bb0e with status ACTIVE [ 601.569512] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.570961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.571091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.571340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.571463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.571697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.571855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.571905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.572097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.572209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.572683] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.572683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.572683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.572683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.572897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.572897] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2bf6d53-fdac-41a7-b276-24cb1179bb0e is going to be updated. [ 601.574089] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.590380] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.590644] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.590783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.591629] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.591629] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.591629] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port d39bbeb8-501f-4557-9323-b4ab6b11d608 not found, creating... [ 601.591789] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.591938] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.591975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.593873] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.593873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.593873] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: d39bbeb8-501f-4557-9323-b4ab6b11d608 is going to be created. [ 601.600319] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.600319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.600319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.600319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.600319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.600319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2bf6d53-fdac-41a7-b276-24cb1179bb0e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.628779] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.629070] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.629157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.629884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.629884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.629884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.752522] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8476d187-425b-4d30-837a-0c5ec5f79c7d [ 601.752774] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.752994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.752994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.753226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.753315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.753417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8476d187-425b-4d30-837a-0c5ec5f79c7d already deleted. [ 601.753502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8476d187-425b-4d30-837a-0c5ec5f79c7d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.924533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 910d8f5e-b96b-481f-9401-addccdb1657a [ 601.924982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.925077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.925202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.925508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.925698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.925833] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:910d8f5e-b96b-481f-9401-addccdb1657a already deleted. [ 601.926010] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-910d8f5e-b96b-481f-9401-addccdb1657a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.077132] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.428671] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f90d003-df2b-4e55-bcfb-c44b8a67fabc req-e0cc4a89-8d93-4bff-8c8c-50d68d918e2f service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 602.428834] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f90d003-df2b-4e55-bcfb-c44b8a67fabc req-e0cc4a89-8d93-4bff-8c8c-50d68d918e2f service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 602.428973] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f90d003-df2b-4e55-bcfb-c44b8a67fabc req-e0cc4a89-8d93-4bff-8c8c-50d68d918e2f service nova] Enqueued Resource ID: d39bbeb8-501f-4557-9323-b4ab6b11d608 with Priority: HIGHEST for action port [ 602.429768] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 602.429908] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 602.430018] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39bbeb8-501f-4557-9323-b4ab6b11d608 with Priority: HIGHEST for action port [ 602.430505] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.430654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.430756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.431088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.431182] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.432927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.433078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.433142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.433316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.433466] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.434264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.434264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.434264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.434264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.434466] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.435367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39bbeb8-501f-4557-9323-b4ab6b11d608 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.435457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.435494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.435686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.435796] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bbeb8-501f-4557-9323-b4ab6b11d608',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.581341] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.581529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.581578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.581782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.581866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.581978] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 is going to be created. [ 602.613132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.613132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.613294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.613381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.613540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.627148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: UNINITIALIZED for 2s [ 602.677021] env[65469]: INFO networking_nsxv3.common.synchronization [None req-3f109142-c1a9-446c-8d92-064385b3c993 None None] Enqueued Resource ID: 8ea2e110-2b97-4805-a401-6941938eb579 with Priority: HIGHEST for action port [ 602.678283] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea2e110-2b97-4805-a401-6941938eb579 with Priority: HIGHEST for action port [ 602.678283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ea2e110-2b97-4805-a401-6941938eb579 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.678283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ea2e110-2b97-4805-a401-6941938eb579" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.678283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ea2e110-2b97-4805-a401-6941938eb579" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.678496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ea2e110-2b97-4805-a401-6941938eb579" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.678575] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ea2e110-2b97-4805-a401-6941938eb579',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.898251] env[65469]: INFO networking_nsxv3.common.synchronization [req-dd5cf6fa-5b3d-4d80-988f-74a4ba2593d3 req-dfb99463-62fe-44f8-a328-c0ce9e9554f5 tempest-FloatingIPsAssociationTestJSON-606961835 tempest-FloatingIPsAssociationTestJSON-606961835-project-member] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 602.898786] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 602.899846] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.899846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.899846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.899846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.899846] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.899846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.900165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.900165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.900922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.900922] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.935468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.935468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.941751] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d39bbeb8-501f-4557-9323-b4ab6b11d608 with status ACTIVE [ 602.942130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.942322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.942322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.942843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.943040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.943653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.943653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.943653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.943653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.943653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.943957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.943957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.943957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.944085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.944119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.944217] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d39bbeb8-501f-4557-9323-b4ab6b11d608 is going to be updated. [ 602.945387] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.969815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.969974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.970058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.970273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.970405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.971456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39bbeb8-501f-4557-9323-b4ab6b11d608" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.180417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ea2e110-2b97-4805-a401-6941938eb579 [ 603.180792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.180792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.180895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.181181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.181286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.181400] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ea2e110-2b97-4805-a401-6941938eb579 already deleted. [ 603.181488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ea2e110-2b97-4805-a401-6941938eb579" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.404516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.404516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.404516] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b already deleted. [ 603.404516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.454570] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.616393] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.617219] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.617219] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.618085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.618085] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.618085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.618085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.618593] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.618835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.619242] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.619457] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.619697] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.620343] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.620343] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.620343] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.620752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.646022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.646022] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.646022] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.646022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.646022] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.646022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.646022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.646022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.646022] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.816209] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4ebd9f87-9189-480e-bb56-1cee3be87528 None None] Enqueued Resource ID: 9d244b1e-65cf-4c74-ae49-c79ad1208aaa with Priority: HIGHEST for action port [ 603.816209] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d244b1e-65cf-4c74-ae49-c79ad1208aaa with Priority: HIGHEST for action port [ 603.816209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d244b1e-65cf-4c74-ae49-c79ad1208aaa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.816209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d244b1e-65cf-4c74-ae49-c79ad1208aaa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.816209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d244b1e-65cf-4c74-ae49-c79ad1208aaa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.816209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d244b1e-65cf-4c74-ae49-c79ad1208aaa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.816209] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d244b1e-65cf-4c74-ae49-c79ad1208aaa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.956855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.957336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.957336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.957706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.957853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.957942] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be created. [ 603.983723] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.984102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.984378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.984709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.984954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.994887] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: UNINITIALIZED for 2s [ 604.149713] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.150020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.150213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.150648] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.150818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.151068] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe not found, creating... [ 604.151563] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.151692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.151925] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.152167] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.152321] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.152604] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.152751] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.153036] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153119] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.153241] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.153410] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe is going to be created. [ 604.175272] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.175526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.175592] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.175850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.176119] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.176299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.323534] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d244b1e-65cf-4c74-ae49-c79ad1208aaa [ 604.323534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.323534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.323534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.323534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.323534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.324504] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d244b1e-65cf-4c74-ae49-c79ad1208aaa already deleted. [ 604.324504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d244b1e-65cf-4c74-ae49-c79ad1208aaa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.550859] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9c6b81d4-42e8-4ee7-9a6a-ab0a342073a3 None None] Enqueued Resource ID: cc0686e4-f3f6-49f9-baab-2a41b0a1e710 with Priority: HIGHEST for action port [ 604.550859] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0686e4-f3f6-49f9-baab-2a41b0a1e710 with Priority: HIGHEST for action port [ 604.550859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0686e4-f3f6-49f9-baab-2a41b0a1e710 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.550859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0686e4-f3f6-49f9-baab-2a41b0a1e710" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.550859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0686e4-f3f6-49f9-baab-2a41b0a1e710" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.551072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0686e4-f3f6-49f9-baab-2a41b0a1e710" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.551415] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0686e4-f3f6-49f9-baab-2a41b0a1e710',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.640794] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: SUCCESS [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.640794] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.640794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.640794] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.907477] env[65469]: INFO networking_nsxv3.common.synchronization [req-dd5cf6fa-5b3d-4d80-988f-74a4ba2593d3 req-8ac194b2-51e4-4fd3-8b09-f231f7b816fa service nova] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_rules [ 604.907675] env[65469]: INFO networking_nsxv3.common.synchronization [req-dd5cf6fa-5b3d-4d80-988f-74a4ba2593d3 req-8ac194b2-51e4-4fd3-8b09-f231f7b816fa service nova] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 604.907829] env[65469]: INFO networking_nsxv3.common.synchronization [req-dd5cf6fa-5b3d-4d80-988f-74a4ba2593d3 req-8ac194b2-51e4-4fd3-8b09-f231f7b816fa service nova] Enqueued Resource ID: 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe with Priority: HIGHEST for action port [ 604.908367] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_rules [ 604.908506] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 604.908604] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe with Priority: HIGHEST for action port [ 604.908947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.909098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.909162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.909405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.909523] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.910318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.910925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.910925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.910925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.910925] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.910925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.911185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.911185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.911242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.911312] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.912047] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.912171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.912216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.912680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.912680] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.053391] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc0686e4-f3f6-49f9-baab-2a41b0a1e710 [ 605.055315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.055315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.055315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.055315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.055315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.055315] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc0686e4-f3f6-49f9-baab-2a41b0a1e710 already deleted. [ 605.055315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0686e4-f3f6-49f9-baab-2a41b0a1e710" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.143797] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.143972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.144052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.144258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.145168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.145168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.145168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.147303] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.147303] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.147303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.147807] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.318142] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4fbd8794-6a79-43d5-a774-796d0cf92096 None None] Enqueued Resource ID: 67d1fe4c-4b36-45ab-a541-bbfb209aa723 with Priority: HIGHEST for action port [ 605.318926] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d1fe4c-4b36-45ab-a541-bbfb209aa723 with Priority: HIGHEST for action port [ 605.319389] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d1fe4c-4b36-45ab-a541-bbfb209aa723 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.319569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d1fe4c-4b36-45ab-a541-bbfb209aa723" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.319678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d1fe4c-4b36-45ab-a541-bbfb209aa723" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.320163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d1fe4c-4b36-45ab-a541-bbfb209aa723" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.320260] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d1fe4c-4b36-45ab-a541-bbfb209aa723',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.416664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.416664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.416664] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.416664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe with status ACTIVE [ 605.416664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.416664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.416664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.416664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.417353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.417353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.417353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.417353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.417476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.417504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.417687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.417791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.417858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.418014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.418247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.418334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe is going to be updated. [ 605.441171] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.441335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.441379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.441590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.441718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.441867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90a2b3cc-9f0f-43c1-9a1b-692d2438e6fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.649617] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7663bbf6-b391-494e-9a60-db9d723b0635: rpc.has_security_group_logging(os_id): False [ 605.667478] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.667629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.667689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.668087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.668087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.668249] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.668350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.668404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.668512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.668607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.668764] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.668857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.668906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.669057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.669254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.669327] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.669457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.669457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.669567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.669645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.669727] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 is going to be created. [ 605.735598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.735598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.735805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.735874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.736104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.748712] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: IN_PROGRESS for 2s [ 605.822121] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d1fe4c-4b36-45ab-a541-bbfb209aa723 [ 605.822388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.823171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.823245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.823820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.823820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.823820] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d1fe4c-4b36-45ab-a541-bbfb209aa723 already deleted. [ 605.823820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d1fe4c-4b36-45ab-a541-bbfb209aa723" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.920315] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.005594] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 606.005825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.006129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.006321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.006540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.006859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.006859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.006996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.007562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.007562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.007562] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.423365] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.423365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.423365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.423822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.424042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.424242] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be created. [ 606.449615] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.449615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.449615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.450040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.450040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.459738] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: UNINITIALIZED for 2s [ 606.511022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.511210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.511288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.511504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.511675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.511771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.511834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.511977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.512080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.512164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.512306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.512416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.512451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.512587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.512755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.512860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.512902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.513046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.513122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.513202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.513461] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.710121] env[65469]: INFO networking_nsxv3.common.synchronization [req-824ae3fc-ea01-4f8d-9b25-67cfbffaff5f req-e9cee1b0-3ae0-4af7-993e-6f02aa14765f tempest-ServerExternalEventsTest-1681596344 tempest-ServerExternalEventsTest-1681596344-project-member] Enqueued Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 606.712943] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 606.712943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.712943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.712943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.712943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.712943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.712943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.712943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.713451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.713451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.713451] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.016628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 607.041680] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.041918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.041918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.042228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.042228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.042384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.042527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.042606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.042769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.042890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.043270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.043270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.043412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.043495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.043591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.043847] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.043977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.044937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.044937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.045048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.045209] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be created. [ 607.124020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.124199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.124800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.124800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.124800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.146389] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 607.164194] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.164377] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.164499] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.164761] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.166300] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.166513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.166639] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.166931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.167091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.167407] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.167600] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.167724] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.167857] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.167991] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.168102] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.168257] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.198311] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.198490] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.198679] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.198860] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.199211] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-06820a25-febd-4fe5-8b1c-6e08de79c0a8 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.199434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.199873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.199962] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.200048] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06820a25-febd-4fe5-8b1c-6e08de79c0a8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.215934] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.216228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.216391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.216686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.216892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.217217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.217416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.217533] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.217832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.217947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.218112] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b already deleted. [ 607.218264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.702329] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.702738] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.702738] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.702977] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.703142] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.703305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 06820a25-febd-4fe5-8b1c-6e08de79c0a8 not found, creating... [ 607.703566] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.703711] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.703851] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704072] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.704202] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.704480] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.704622] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.704731] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704926] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.705075] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.705294] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 06820a25-febd-4fe5-8b1c-6e08de79c0a8 is going to be created. [ 607.734834] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.735176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.735312] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.735647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.735991] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.736130] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.765100] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: SUCCESS [ 607.765100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.952943] env[65469]: INFO networking_nsxv3.common.synchronization [None req-3f235d34-4f38-47c9-b788-f0fa8f025ca7 None None] Enqueued Resource ID: 03471e6b-6431-4e09-af17-96bcdc70ef37 with Priority: HIGHEST for action port [ 607.953226] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03471e6b-6431-4e09-af17-96bcdc70ef37 with Priority: HIGHEST for action port [ 607.953830] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-03471e6b-6431-4e09-af17-96bcdc70ef37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.953979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03471e6b-6431-4e09-af17-96bcdc70ef37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.954093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03471e6b-6431-4e09-af17-96bcdc70ef37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.954428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03471e6b-6431-4e09-af17-96bcdc70ef37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.954516] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03471e6b-6431-4e09-af17-96bcdc70ef37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.968786] env[65469]: INFO networking_nsxv3.common.synchronization [None req-b4f78088-829e-4ce8-be99-67e1a7d5c1b1 None None] Enqueued Resource ID: 45d9b9e9-af00-4689-b7a7-985a5a01ea49 with Priority: HIGHEST for action port [ 607.969318] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9b9e9-af00-4689-b7a7-985a5a01ea49 with Priority: HIGHEST for action port [ 607.969627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-45d9b9e9-af00-4689-b7a7-985a5a01ea49 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.969745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45d9b9e9-af00-4689-b7a7-985a5a01ea49" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.969813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45d9b9e9-af00-4689-b7a7-985a5a01ea49" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.970162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45d9b9e9-af00-4689-b7a7-985a5a01ea49" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.970244] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45d9b9e9-af00-4689-b7a7-985a5a01ea49',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.419024] env[65469]: INFO networking_nsxv3.common.synchronization [req-824ae3fc-ea01-4f8d-9b25-67cfbffaff5f req-19d9e305-22bd-4040-8650-c9f5f079e3a5 service nova] Enqueued Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_rules [ 608.419202] env[65469]: INFO networking_nsxv3.common.synchronization [req-824ae3fc-ea01-4f8d-9b25-67cfbffaff5f req-19d9e305-22bd-4040-8650-c9f5f079e3a5 service nova] Enqueued Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 608.419339] env[65469]: INFO networking_nsxv3.common.synchronization [req-824ae3fc-ea01-4f8d-9b25-67cfbffaff5f req-19d9e305-22bd-4040-8650-c9f5f079e3a5 service nova] Enqueued Resource ID: 06820a25-febd-4fe5-8b1c-6e08de79c0a8 with Priority: HIGHEST for action port [ 608.425381] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_rules [ 608.425381] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 608.425381] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06820a25-febd-4fe5-8b1c-6e08de79c0a8 with Priority: HIGHEST for action port [ 608.425381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.425381] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.425381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.425381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.425381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.426144] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.426187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-06820a25-febd-4fe5-8b1c-6e08de79c0a8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.427524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.427524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.427524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.427524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06820a25-febd-4fe5-8b1c-6e08de79c0a8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.457456] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03471e6b-6431-4e09-af17-96bcdc70ef37 [ 608.457675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.458807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.458885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.459121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.459212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.459309] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03471e6b-6431-4e09-af17-96bcdc70ef37 already deleted. [ 608.459389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03471e6b-6431-4e09-af17-96bcdc70ef37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.469599] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 608.469809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.469965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.470194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.470382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.470484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.470539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.470687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.470763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.470849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.470935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.471808] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45d9b9e9-af00-4689-b7a7-985a5a01ea49 [ 608.471977] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.472127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.472210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.472418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.473088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.473182] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45d9b9e9-af00-4689-b7a7-985a5a01ea49 already deleted. [ 608.473289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45d9b9e9-af00-4689-b7a7-985a5a01ea49" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.534781] env[65469]: INFO networking_nsxv3.common.synchronization [None req-f0f50e12-d85c-47c1-b9a4-258835e0f1c8 None None] Enqueued Resource ID: 6c14382d-3344-4ffe-9239-f23bd83302d4 with Priority: HIGHEST for action port [ 608.535407] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c14382d-3344-4ffe-9239-f23bd83302d4 with Priority: HIGHEST for action port [ 608.535767] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c14382d-3344-4ffe-9239-f23bd83302d4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.536293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c14382d-3344-4ffe-9239-f23bd83302d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.536293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c14382d-3344-4ffe-9239-f23bd83302d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.536491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c14382d-3344-4ffe-9239-f23bd83302d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.536778] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c14382d-3344-4ffe-9239-f23bd83302d4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.929651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.929963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.930500] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.931468] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06820a25-febd-4fe5-8b1c-6e08de79c0a8 with status ACTIVE [ 608.934382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.934382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.934382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.934382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.935133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.935133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.935133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.935133] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06820a25-febd-4fe5-8b1c-6e08de79c0a8 is going to be updated. [ 608.961708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.962224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.962976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.962976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.962976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.962976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06820a25-febd-4fe5-8b1c-6e08de79c0a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.977135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.977522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.977522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.977638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977945] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.978109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.978210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.978305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.978432] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.039429] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c14382d-3344-4ffe-9239-f23bd83302d4 [ 609.039678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.039816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.039883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.040219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.040219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.040329] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c14382d-3344-4ffe-9239-f23bd83302d4 already deleted. [ 609.040398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c14382d-3344-4ffe-9239-f23bd83302d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.160645] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 609.160973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.437177] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.480776] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b09b8988-0604-4099-985a-5dc6c13cf18b: rpc.has_security_group_logging(os_id): False [ 609.498890] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.499416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.499416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.499518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.499574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.499790] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.499887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.499946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.500116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.500189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.500365] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.500453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.500510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.500649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.500719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.501310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.501310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.501310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.501310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.501310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.501310] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be created. [ 609.559864] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.560105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.560105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.560856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.560856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.581654] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 609.918273] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a0fede38-f54a-47db-b00e-847c7c116e2b tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 609.918750] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 609.919217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.920293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.921927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.921927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.921927] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.939714] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.939714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.940262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.940262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.940262] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b is going to be created. [ 609.971270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.971474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.971474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.972822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.972822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.984749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: UNINITIALIZED for 2s [ 610.150271] env[65469]: INFO networking_nsxv3.common.synchronization [None req-1fcff569-b98a-4905-8b4b-20242a8f8e35 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 610.150784] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 610.151135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.151221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.444507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.444812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.444812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.444938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.445046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.445274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 already deleted. [ 610.445274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.445382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.445553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.445637] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.973185] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.973737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.973737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.973737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.973929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.973929] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 already deleted. [ 610.974054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.142073] env[65469]: INFO networking_nsxv3.common.synchronization [None req-f1fbebe1-1138-4e70-bf22-f82ae8dfa0c9 tempest-ServerActionsV293TestJSON-298286975 tempest-ServerActionsV293TestJSON-298286975-project-member] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 611.142315] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 611.143032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.143032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.143032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.143032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.143032] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.548331] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7afa4281-4f6c-4693-a469-6c69dba57077 tempest-ServerActionsV293TestJSON-298286975 tempest-ServerActionsV293TestJSON-298286975-project-member] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 611.548638] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 611.550289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.550289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.594136] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 611.594387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.671216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.671384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.671384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.671575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.671717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.671774] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae already deleted. [ 611.672063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.672063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.672214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.672214] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.997231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: SUCCESS [ 611.997824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.997824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.998245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.998245] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.998434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.998489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.998741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.998741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.998980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.998980] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.187391] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c74f1c9e-29a5-4e2c-be7a-a2e27d08eff3 None None] Enqueued Resource ID: e9dae6b0-8fde-4021-a92a-1590809eec29 with Priority: HIGHEST for action port [ 612.190043] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9dae6b0-8fde-4021-a92a-1590809eec29 with Priority: HIGHEST for action port [ 612.190043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9dae6b0-8fde-4021-a92a-1590809eec29 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.190043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9dae6b0-8fde-4021-a92a-1590809eec29" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.190043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9dae6b0-8fde-4021-a92a-1590809eec29" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.190043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9dae6b0-8fde-4021-a92a-1590809eec29" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.190043] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9dae6b0-8fde-4021-a92a-1590809eec29',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.200974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.200974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.200974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.200974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.200974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.200974] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae already deleted. [ 612.200974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.501773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.502057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.502455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.502721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.502900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.503018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.503103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.503340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.503509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.503684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.503947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.504039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.504121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.504376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.504563] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.504724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.504940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.505203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.505331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.505500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.505675] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.693640] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9dae6b0-8fde-4021-a92a-1590809eec29 [ 612.693931] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.694267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.694267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.694791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.694791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.694960] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9dae6b0-8fde-4021-a92a-1590809eec29 already deleted. [ 612.695029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9dae6b0-8fde-4021-a92a-1590809eec29" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.009842] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c50b4159-45fc-44a4-bf5d-d24f04e41f7b: rpc.has_security_group_logging(os_id): False [ 613.030782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.030782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.030782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.030782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.031990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.032597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.032597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.034275] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.034275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.034275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.034275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.034275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.034275] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b is going to be created. [ 613.102139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.102329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.102403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.102701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.102943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.119064] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: IN_PROGRESS for 2s [ 614.507297] env[65469]: INFO networking_nsxv3.common.synchronization [req-267a99a9-a528-4121-8061-faa5e00f5595 req-603120e3-804c-4757-a551-a006c4649efd tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 614.507297] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 614.507297] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.507297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.507297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.507297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.507297] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.507297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.507297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.508512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.508512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.508512] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.513889] env[65469]: INFO networking_nsxv3.common.synchronization [None req-de80638f-8fc0-4d7a-ae05-0ca1d7c05f17 None None] Enqueued Resource ID: 8c75bf6e-21bf-4c8a-bed1-345645ad7393 with Priority: HIGHEST for action port [ 614.515076] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c75bf6e-21bf-4c8a-bed1-345645ad7393 with Priority: HIGHEST for action port [ 614.515420] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c75bf6e-21bf-4c8a-bed1-345645ad7393 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.515579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c75bf6e-21bf-4c8a-bed1-345645ad7393" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.515621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c75bf6e-21bf-4c8a-bed1-345645ad7393" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.515883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c75bf6e-21bf-4c8a-bed1-345645ad7393" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.515966] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c75bf6e-21bf-4c8a-bed1-345645ad7393',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.847631] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c484fbec-563d-4f89-9112-64518af7d414 None None] Enqueued Resource ID: 597e9444-8927-44f1-8b10-1f77358389a7 with Priority: HIGHEST for action port [ 614.848151] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597e9444-8927-44f1-8b10-1f77358389a7 with Priority: HIGHEST for action port [ 614.848504] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-597e9444-8927-44f1-8b10-1f77358389a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.848606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-597e9444-8927-44f1-8b10-1f77358389a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.849424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-597e9444-8927-44f1-8b10-1f77358389a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.849998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-597e9444-8927-44f1-8b10-1f77358389a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.850112] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('597e9444-8927-44f1-8b10-1f77358389a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.863673] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.863915] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.864070] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.864346] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.864619] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.864793] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.864943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.865328] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.865446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.865648] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.865756] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.865860] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.865962] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.866086] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.866219] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.866365] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.892184] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.892359] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.892494] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.892668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.893016] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.893164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.893283] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.893634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.893772] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c905cdd2-03f9-4ee7-93f8-978a9fcaf155',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.012039] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.012039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.012039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.013909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.013909] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 already deleted. [ 615.013909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.021602] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c75bf6e-21bf-4c8a-bed1-345645ad7393 [ 615.021800] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.021923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.022019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.022411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.022527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.022622] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c75bf6e-21bf-4c8a-bed1-345645ad7393 already deleted. [ 615.022702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c75bf6e-21bf-4c8a-bed1-345645ad7393" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.130729] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: SUCCESS [ 615.130729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.352971] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 597e9444-8927-44f1-8b10-1f77358389a7 [ 615.353256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.353394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.353456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.354037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.354037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.354037] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:597e9444-8927-44f1-8b10-1f77358389a7 already deleted. [ 615.354037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-597e9444-8927-44f1-8b10-1f77358389a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.397333] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.399352] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port c905cdd2-03f9-4ee7-93f8-978a9fcaf155 not found, creating... [ 615.399352] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.399352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.401170] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.401663] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.401941] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.402212] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.402349] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.402487] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: c905cdd2-03f9-4ee7-93f8-978a9fcaf155 is going to be created. [ 615.427585] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.427793] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.428022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.428312] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.429489] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.429489] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.102980] env[65469]: INFO networking_nsxv3.common.synchronization [req-5c58c3b2-4ab6-4ee0-a8eb-2ddde0b16d95 req-b3230fb5-0f60-4b70-8440-b4ef04c2f8fd tempest-VolumesAssistedSnapshotsTest-325735266 tempest-VolumesAssistedSnapshotsTest-325735266-project-member] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 616.103579] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 616.103926] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.104071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.104176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.104448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.104638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.104819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.104881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.105040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.105435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.105435] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.188326] env[65469]: INFO networking_nsxv3.common.synchronization [req-267a99a9-a528-4121-8061-faa5e00f5595 req-7c5ac888-9e89-456b-afdd-b7d97c805ca0 service nova] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_rules [ 616.188534] env[65469]: INFO networking_nsxv3.common.synchronization [req-267a99a9-a528-4121-8061-faa5e00f5595 req-7c5ac888-9e89-456b-afdd-b7d97c805ca0 service nova] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 616.188748] env[65469]: INFO networking_nsxv3.common.synchronization [req-267a99a9-a528-4121-8061-faa5e00f5595 req-7c5ac888-9e89-456b-afdd-b7d97c805ca0 service nova] Enqueued Resource ID: c905cdd2-03f9-4ee7-93f8-978a9fcaf155 with Priority: HIGHEST for action port [ 616.189709] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_rules [ 616.189784] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 616.189935] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c905cdd2-03f9-4ee7-93f8-978a9fcaf155 with Priority: HIGHEST for action port [ 616.190478] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.190478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.190478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.191537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.191537] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.192346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.192467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.192553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.192756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.192914] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.193145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.193225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.193389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.193492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.193597] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.194446] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.194552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.194632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.194789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.194897] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c905cdd2-03f9-4ee7-93f8-978a9fcaf155',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.511551] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.513199] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-259" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.513721] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-259" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.513998] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-259" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.514373] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.514611] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.514768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.515061] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.515246] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.515682] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.515827] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.515976] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.516127] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.516252] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.516358] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.516632] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.535791] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.535970] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.536183] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.536361] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-259" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.536597] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-07aa05e9-c169-47cf-b619-39a3fdad1b83 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.536752] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.536864] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.537344] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.537507] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07aa05e9-c169-47cf-b619-39a3fdad1b83',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.613331] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.613331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.613331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.613331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.613331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.613668] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.613668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.613668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.613781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.613880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.614564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 already deleted. [ 616.614564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.697379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.697507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.697740] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.698688] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c905cdd2-03f9-4ee7-93f8-978a9fcaf155 with status ACTIVE [ 616.701564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.701564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.701564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.702179] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.702274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.702355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.702491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.702572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.702665] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c905cdd2-03f9-4ee7-93f8-978a9fcaf155 is going to be updated. [ 616.729170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.729613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.729701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.729923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.730088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.730765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c905cdd2-03f9-4ee7-93f8-978a9fcaf155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.914304] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8cc00eb1-c111-4e77-a013-e2f3c92cc3bc None None] Enqueued Resource ID: 7d49a7fd-a9da-4a48-8c29-b50665b5b35f with Priority: HIGHEST for action port [ 616.914666] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d49a7fd-a9da-4a48-8c29-b50665b5b35f with Priority: HIGHEST for action port [ 616.915014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d49a7fd-a9da-4a48-8c29-b50665b5b35f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.915805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d49a7fd-a9da-4a48-8c29-b50665b5b35f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.915805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d49a7fd-a9da-4a48-8c29-b50665b5b35f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.915805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d49a7fd-a9da-4a48-8c29-b50665b5b35f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.916075] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d49a7fd-a9da-4a48-8c29-b50665b5b35f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.041784] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.042130] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.042269] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.042560] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.042707] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.042861] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 07aa05e9-c169-47cf-b619-39a3fdad1b83 not found, creating... [ 617.043158] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.043323] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.043495] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.043732] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.043868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.044259] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.045087] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.045236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.045443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.045572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.045711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 07aa05e9-c169-47cf-b619-39a3fdad1b83 is going to be created. [ 617.068365] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.068572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.068692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.068963] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.069208] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.069429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.207265] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.420626] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d49a7fd-a9da-4a48-8c29-b50665b5b35f [ 617.421049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.421987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.421987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.421987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.421987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.421987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d49a7fd-a9da-4a48-8c29-b50665b5b35f already deleted. [ 617.421987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d49a7fd-a9da-4a48-8c29-b50665b5b35f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.710457] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.710688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.710688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.711013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.711115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.711178] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be created. [ 617.736434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.736601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.736648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.736834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.737047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.747415] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: UNINITIALIZED for 2s [ 617.817082] env[65469]: INFO networking_nsxv3.common.synchronization [req-5c58c3b2-4ab6-4ee0-a8eb-2ddde0b16d95 req-5761b426-5984-4c38-a73d-3d3efb3b53e8 service nova] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 617.817273] env[65469]: INFO networking_nsxv3.common.synchronization [req-5c58c3b2-4ab6-4ee0-a8eb-2ddde0b16d95 req-5761b426-5984-4c38-a73d-3d3efb3b53e8 service nova] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 617.817411] env[65469]: INFO networking_nsxv3.common.synchronization [req-5c58c3b2-4ab6-4ee0-a8eb-2ddde0b16d95 req-5761b426-5984-4c38-a73d-3d3efb3b53e8 service nova] Enqueued Resource ID: 07aa05e9-c169-47cf-b619-39a3fdad1b83 with Priority: HIGHEST for action port [ 617.817930] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_rules [ 617.818139] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 617.818214] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07aa05e9-c169-47cf-b619-39a3fdad1b83 with Priority: HIGHEST for action port [ 617.818851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.819015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.821119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.821403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.821472] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.822336] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.822626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.822626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.823674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.823674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.823674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.823674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.823674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.823674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.823674] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.824050] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-07aa05e9-c169-47cf-b619-39a3fdad1b83 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.824196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.824246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.824416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.824471] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07aa05e9-c169-47cf-b619-39a3fdad1b83',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.309026] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7a9f09de-9244-4697-b1ed-7431e5f122ce None None] Enqueued Resource ID: b76b3783-9416-4501-9ddf-495abe41fc95 with Priority: HIGHEST for action port [ 618.309636] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b76b3783-9416-4501-9ddf-495abe41fc95 with Priority: HIGHEST for action port [ 618.310036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b76b3783-9416-4501-9ddf-495abe41fc95 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.312746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b76b3783-9416-4501-9ddf-495abe41fc95" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.312746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b76b3783-9416-4501-9ddf-495abe41fc95" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.312746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b76b3783-9416-4501-9ddf-495abe41fc95" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.312746] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76b3783-9416-4501-9ddf-495abe41fc95',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.326788] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.326788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.326900] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.327910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07aa05e9-c169-47cf-b619-39a3fdad1b83 with status ACTIVE [ 618.328125] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.328275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.328340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.330056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.330056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.330056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.330486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.333047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07aa05e9-c169-47cf-b619-39a3fdad1b83 is going to be updated. [ 618.359559] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.359559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.359559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.359559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.359559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.359559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07aa05e9-c169-47cf-b619-39a3fdad1b83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.744663] env[65469]: INFO networking_nsxv3.common.synchronization [None req-264b52f3-141b-416c-82b0-c07a613193df tempest-ServersTestFqdnHostnames-603046965 tempest-ServersTestFqdnHostnames-603046965-project-member] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 618.745258] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 618.745570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.746112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.746112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.746112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.749430] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.813305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b76b3783-9416-4501-9ddf-495abe41fc95 [ 618.813426] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.813494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.813562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.814062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.814166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.814504] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b76b3783-9416-4501-9ddf-495abe41fc95 already deleted. [ 618.814609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b76b3783-9416-4501-9ddf-495abe41fc95" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.833089] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.898503] env[65469]: INFO networking_nsxv3.common.synchronization [None req-54301930-7fcf-4043-80d6-16302b9cd3b5 tempest-ServersTestFqdnHostnames-603046965 tempest-ServersTestFqdnHostnames-603046965-project-member] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 618.899161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 618.899870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.899870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.272030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.272074] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.272309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.272411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.273018] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 already deleted. [ 619.273135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.273301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.273476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.273561] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.336862] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.337218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.337218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.337356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.337449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.337546] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 is going to be created. [ 619.362455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.362609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.362654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.362854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.363016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.372773] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: UNINITIALIZED for 2s [ 619.759424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 619.759708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.760621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.760621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.760947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.760947] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.795571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.795571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.795571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.795781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.795873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.795977] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 already deleted. [ 619.796054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.263537] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.263537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.263537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.264313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.264651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.265419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.265566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.265828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.265978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.266365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.266638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.266811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.266971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.267302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.267584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.267584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.267689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.267868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.267971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268167] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.674725] env[65469]: INFO networking_nsxv3.common.synchronization [req-ede12bc1-3a5c-4943-94ae-fc77a3bbc19f req-8ada9667-d476-43c5-864b-06b19aa7eecf tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 620.677055] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 620.677055] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.677055] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.677055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.677055] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.770913] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80280ff5-2173-4569-9e09-d7fdc89693a7: rpc.has_security_group_logging(os_id): False [ 620.798198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.798370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.798421] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.798683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.798806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.799024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.799171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.799253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.799483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.799604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.799859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.799978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.800336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.800535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.800627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.800845] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.800973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.801086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.801290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.801380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.801470] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be created. [ 620.882573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.882808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.882808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.883023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.884048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.902528] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 621.179124] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.179348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.179409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.179988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.179988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.180158] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.180158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.180255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.180404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.180478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.180692] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 already deleted. [ 621.180692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.385057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: SUCCESS [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.387064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.387064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.387399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.387399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.387399] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.441727] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.441928] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.442060] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.442326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.442575] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.442726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.442835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.443065] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.443211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.443410] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.443518] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.443622] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.443724] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.443826] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.443926] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.444062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.464453] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.464755] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.464923] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.465138] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.465478] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-724a220d-b454-4ffc-862c-f7c2754b0043 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.465658] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.465773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.466149] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.466674] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724a220d-b454-4ffc-862c-f7c2754b0043',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.890567] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.969264] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.969735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.969735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.969981] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.970050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.970204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 724a220d-b454-4ffc-862c-f7c2754b0043 not found, creating... [ 621.970495] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.970635] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.970745] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.970963] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.971114] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.971395] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.971546] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.971660] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.971861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.971992] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.972180] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 724a220d-b454-4ffc-862c-f7c2754b0043 is going to be created. [ 621.994604] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.994865] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.995012] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.995298] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.995608] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.995833] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.393252] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92bf433d-c39b-4344-960c-b8e0607c3036: rpc.has_security_group_logging(os_id): False [ 622.412745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.413090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.413090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.413405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.413577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.413958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.414147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.414271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.414536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.414680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.414833] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 is going to be created. [ 622.482955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.483466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.483466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.483466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.483579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.496648] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: IN_PROGRESS for 2s [ 622.712337] env[65469]: INFO networking_nsxv3.common.synchronization [req-ede12bc1-3a5c-4943-94ae-fc77a3bbc19f req-f36f13a8-a59e-4c6d-a606-077bc2ab5291 service nova] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_rules [ 622.712510] env[65469]: INFO networking_nsxv3.common.synchronization [req-ede12bc1-3a5c-4943-94ae-fc77a3bbc19f req-f36f13a8-a59e-4c6d-a606-077bc2ab5291 service nova] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 622.712642] env[65469]: INFO networking_nsxv3.common.synchronization [req-ede12bc1-3a5c-4943-94ae-fc77a3bbc19f req-f36f13a8-a59e-4c6d-a606-077bc2ab5291 service nova] Enqueued Resource ID: 724a220d-b454-4ffc-862c-f7c2754b0043 with Priority: HIGHEST for action port [ 622.713149] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_rules [ 622.713283] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 622.713381] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724a220d-b454-4ffc-862c-f7c2754b0043 with Priority: HIGHEST for action port [ 622.713687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.713918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.713918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.714217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.714288] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.715139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.715255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.715322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.715519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.715669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.719021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.719021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-724a220d-b454-4ffc-862c-f7c2754b0043 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.719021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.719021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724a220d-b454-4ffc-862c-f7c2754b0043',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.916216] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 622.916216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.221992] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.221992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.221992] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.222236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 724a220d-b454-4ffc-862c-f7c2754b0043 with status ACTIVE [ 623.222352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.222427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.222466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.223049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.223049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.223049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.223049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.223246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.223285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.223344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.223524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.227295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.229453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.229453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.229453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.229453] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 724a220d-b454-4ffc-862c-f7c2754b0043 is going to be updated. [ 623.252678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.252859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.252904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.253238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.253325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.253480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-724a220d-b454-4ffc-862c-f7c2754b0043" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.534266] env[65469]: INFO networking_nsxv3.common.synchronization [req-a18e97e6-965d-4e58-b1bd-a21de759ad01 req-81e5ab34-4571-4282-b8e6-ed8168810e77 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 623.534266] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 623.534266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.534266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.534266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.536679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.536797] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.536859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.536897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.537405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.541283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.541832] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.622671] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e5aea443-fa4a-4cfe-bb7a-2a2f438bd7e1 None None] Enqueued Resource ID: 2b455911-cf1b-4f67-9015-da8e1c1309d0 with Priority: HIGHEST for action port [ 623.622671] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b455911-cf1b-4f67-9015-da8e1c1309d0 with Priority: HIGHEST for action port [ 623.622671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b455911-cf1b-4f67-9015-da8e1c1309d0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.622671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b455911-cf1b-4f67-9015-da8e1c1309d0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.622671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b455911-cf1b-4f67-9015-da8e1c1309d0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.623408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b455911-cf1b-4f67-9015-da8e1c1309d0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.623408] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b455911-cf1b-4f67-9015-da8e1c1309d0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.731530] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.961398] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.961398] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.961398] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.961798] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.961798] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.961910] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.961977] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.964023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.964023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.965169] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.965169] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.965169] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.965169] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.965169] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.965512] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.965512] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.992346] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.992511] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.992641] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.993330] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.993330] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.993330] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.993537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.993701] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.994026] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98acc2f9-ae60-456e-ac90-5bdb589aa6dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.044860] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.045322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.045535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.045812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.046096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.046270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.046270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.046372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.046527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.046609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.046697] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 already deleted. [ 624.046790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.125691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b455911-cf1b-4f67-9015-da8e1c1309d0 [ 624.126597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.126597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.126597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.126597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.126781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.126781] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b455911-cf1b-4f67-9015-da8e1c1309d0 already deleted. [ 624.126837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b455911-cf1b-4f67-9015-da8e1c1309d0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.236938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.238218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.238218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.238218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.238218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.238218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be created. [ 624.266705] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.266705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.266705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.266861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.266951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.280802] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: UNINITIALIZED for 2s [ 624.497091] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.497091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.497091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.497498] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.497498] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.497697] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 98acc2f9-ae60-456e-ac90-5bdb589aa6dd not found, creating... [ 624.498029] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.498420] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.498586] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.498932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.499164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.499444] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.499601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.499713] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.499938] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.500110] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.500255] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd is going to be created. [ 624.515952] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: SUCCESS [ 624.516183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.526857] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.527168] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.527339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.527697] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.528128] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.528486] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.275591] env[65469]: INFO networking_nsxv3.common.synchronization [req-a18e97e6-965d-4e58-b1bd-a21de759ad01 req-ae6498e6-a4a1-48b0-87c0-01b3d8618cc2 service nova] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 625.275591] env[65469]: INFO networking_nsxv3.common.synchronization [req-a18e97e6-965d-4e58-b1bd-a21de759ad01 req-ae6498e6-a4a1-48b0-87c0-01b3d8618cc2 service nova] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 625.275591] env[65469]: INFO networking_nsxv3.common.synchronization [req-a18e97e6-965d-4e58-b1bd-a21de759ad01 req-ae6498e6-a4a1-48b0-87c0-01b3d8618cc2 service nova] Enqueued Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 625.277735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 625.277735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 625.277735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 625.278149] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.278525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.278696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.279481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.279676] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.280905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286504] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.286504] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.286504] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.286504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286504] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98acc2f9-ae60-456e-ac90-5bdb589aa6dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.695671] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e34b23a0-389d-42c4-8fcc-0be1bb4f023c tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 625.695671] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 625.695994] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.695994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.695994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.698039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.698211] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.791036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.791221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.791447] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.793103] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with status ACTIVE [ 625.793405] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.793628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.793757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.794185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.794287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.794495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.794630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.794755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.794887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.794968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.795165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.795264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.795328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.795469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.795543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.795630] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd is going to be updated. [ 625.820984] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.821582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.821582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.821582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.821582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.821766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.852688] env[65469]: INFO networking_nsxv3.common.synchronization [None req-565992ef-9064-40ad-b96b-adab533c94b8 tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 625.853400] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 625.855038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.855038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.070654] env[65469]: INFO networking_nsxv3.common.synchronization [None req-66d305db-cdea-4f2b-9c57-e5b8f4b9724c None None] Enqueued Resource ID: 64c3a11e-4f0d-4d0e-a655-a6f1a7864f99 with Priority: HIGHEST for action port [ 626.070654] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c3a11e-4f0d-4d0e-a655-a6f1a7864f99 with Priority: HIGHEST for action port [ 626.071778] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-64c3a11e-4f0d-4d0e-a655-a6f1a7864f99 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.072461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64c3a11e-4f0d-4d0e-a655-a6f1a7864f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.072738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64c3a11e-4f0d-4d0e-a655-a6f1a7864f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.073614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64c3a11e-4f0d-4d0e-a655-a6f1a7864f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.073884] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64c3a11e-4f0d-4d0e-a655-a6f1a7864f99',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.219691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.219840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.219899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.220140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.220949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.220949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 already deleted. [ 626.220949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.220949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.220949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.220949] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.293165] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 626.293474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.293628] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.294458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.294823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.294883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.295013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.295087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.295254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.295354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.296528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.297015] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.576458] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64c3a11e-4f0d-4d0e-a655-a6f1a7864f99 [ 626.576458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.576630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.576825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.577111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.577206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.577352] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64c3a11e-4f0d-4d0e-a655-a6f1a7864f99 already deleted. [ 626.577394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64c3a11e-4f0d-4d0e-a655-a6f1a7864f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.749756] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.749920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.750042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.750234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.750329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.750428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 already deleted. [ 626.750513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.783313] env[65469]: INFO networking_nsxv3.common.synchronization [req-ae5d1761-f88f-472a-b34f-24ad02589c3c req-31347c63-3f7c-498d-90be-b191fbc7f2cd tempest-VolumesAdminNegativeTest-1212511974 tempest-VolumesAdminNegativeTest-1212511974-project-member] Enqueued Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 626.783922] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 626.785809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.785943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.786336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786502] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.786828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.787020] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.799178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.800884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.801482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.801721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.801859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.801969] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be created. [ 626.803900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.803900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.803900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.804105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.804189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.804295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.804363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.805673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.805673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.805673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.806071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.806071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.806071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.806071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.806230] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.833737] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.833964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.834116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.834471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.834775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.846849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: UNINITIALIZED for 2s [ 627.185923] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.186144] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-209" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.186429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-209" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.186599] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-209" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.186855] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.187023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.187155] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.187369] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.187509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.187740] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.187813] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.187913] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.188025] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.188159] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.188279] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.188383] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.212682] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.212853] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.212958] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.213324] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-209" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.213508] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a764c290-1491-4aff-8741-8e570de03ac9 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.213677] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.213794] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.214128] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.214259] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a764c290-1491-4aff-8741-8e570de03ac9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.292809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.293128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.293276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.293531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.293656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.293844] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.293943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.294182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.294247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.294349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.294461] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 already deleted. [ 627.294565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.309775] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1934be84-8ae3-4bd7-9b51-c38b417cac45: rpc.has_security_group_logging(os_id): False [ 627.344662] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.344662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.344662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.344902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.344902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.345111] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.345223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.345328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.345449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.345579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.346109] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.346109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.346109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.346109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.346109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.347224] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.347224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.347224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.347224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.347224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.347224] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be created. [ 627.412247] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.412478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.412558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.412789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.412981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.425896] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 627.716572] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.716768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.717939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.717939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.717939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.717939] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a764c290-1491-4aff-8741-8e570de03ac9 not found, creating... [ 627.717939] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.718723] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.718723] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.718723] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.718922] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.719145] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.719308] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.719496] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.719760] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.719888] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.720148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a764c290-1491-4aff-8741-8e570de03ac9 is going to be created. [ 627.743550] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.743649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.743745] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.744035] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.744262] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.744541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.469401] env[65469]: INFO networking_nsxv3.common.synchronization [req-ae5d1761-f88f-472a-b34f-24ad02589c3c req-45059f4c-833c-4c59-af42-879294142475 service nova] Enqueued Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_rules [ 628.469645] env[65469]: INFO networking_nsxv3.common.synchronization [req-ae5d1761-f88f-472a-b34f-24ad02589c3c req-45059f4c-833c-4c59-af42-879294142475 service nova] Enqueued Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 628.469694] env[65469]: INFO networking_nsxv3.common.synchronization [req-ae5d1761-f88f-472a-b34f-24ad02589c3c req-45059f4c-833c-4c59-af42-879294142475 service nova] Enqueued Resource ID: a764c290-1491-4aff-8741-8e570de03ac9 with Priority: HIGHEST for action port [ 628.470323] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_rules [ 628.470471] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 628.470575] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a764c290-1491-4aff-8741-8e570de03ac9 with Priority: HIGHEST for action port [ 628.470895] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.471056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.472543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.472945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.473882] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.475541] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.475677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.475766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.475938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.476110] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.476214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.476274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.476459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.476554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.476649] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.477947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a764c290-1491-4aff-8741-8e570de03ac9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.478070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.478190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.478329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.478408] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a764c290-1491-4aff-8741-8e570de03ac9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.860115] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 628.860406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.860680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.861025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.861182] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.861182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.861328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.861376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.862032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.862032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.862032] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.983298] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.986311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.986311] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a764c290-1491-4aff-8741-8e570de03ac9 with status ACTIVE [ 628.986311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.986311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.986311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.986311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.986914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.986914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.986914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.986914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.986914] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a764c290-1491-4aff-8741-8e570de03ac9 is going to be updated. [ 629.014968] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.015157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.015157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.015383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.015473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.015975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a764c290-1491-4aff-8741-8e570de03ac9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.083207] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6dd1a09f-e3db-4ecc-b114-1aa4d2f80adf None None] Enqueued Resource ID: d15368cc-a37f-4b53-8128-004c3cfd8772 with Priority: HIGHEST for action port [ 629.083764] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15368cc-a37f-4b53-8128-004c3cfd8772 with Priority: HIGHEST for action port [ 629.084164] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d15368cc-a37f-4b53-8128-004c3cfd8772 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.084326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d15368cc-a37f-4b53-8128-004c3cfd8772" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.084429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d15368cc-a37f-4b53-8128-004c3cfd8772" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.084723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d15368cc-a37f-4b53-8128-004c3cfd8772" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.084816] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d15368cc-a37f-4b53-8128-004c3cfd8772',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.367913] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.368088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.368254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.368445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.368621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.368754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.368789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.368931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.369072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.369133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.369318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.369422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.369482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.369632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.369770] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.369859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.369917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.370064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.371071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.372174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.372174] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.443127] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 629.443127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.485508] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.589342] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d15368cc-a37f-4b53-8128-004c3cfd8772 [ 629.589620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.589757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.589829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.590130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.590248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.590385] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d15368cc-a37f-4b53-8128-004c3cfd8772 already deleted. [ 629.590508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d15368cc-a37f-4b53-8128-004c3cfd8772" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.878451] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 629.899636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.899902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.899973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.903310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.903310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.903310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.903310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.904624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.904624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.904624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.904624] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be created. [ 629.908026] env[65469]: INFO networking_nsxv3.common.synchronization [req-1abe7517-c52a-4675-baf8-cd361833dd9f req-359c31df-4baf-4ccb-887f-6be772fd6325 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 629.908490] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 629.909801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.909801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.909801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.909801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.909801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.910106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.911090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.911090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.911090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.911090] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.981300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.982252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.982252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.982252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.982252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.993350] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.993710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.993756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.993958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.994304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.994304] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 is going to be created. [ 630.008729] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 630.032474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.033483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.033483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.033483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.033483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.053610] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: UNINITIALIZED for 2s [ 630.413452] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.413656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.413823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.413969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.414085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.414407] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.414407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.414567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.414617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.414686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.414982] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 already deleted. [ 630.414982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.436865] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.437150] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.437214] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.437527] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.437787] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.437939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.438093] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.438404] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.438570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.438836] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.438885] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.438971] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.439115] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.439194] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.439293] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.439435] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.464702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.464910] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.465040] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.465301] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.465737] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-7907bac7-663a-465e-a1bb-4840c37713da taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.465943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.466083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.466481] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.466620] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7907bac7-663a-465e-a1bb-4840c37713da',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.970438] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.970438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.970438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.970818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.970818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.970890] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 7907bac7-663a-465e-a1bb-4840c37713da not found, creating... [ 630.971931] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.971931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.971931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.971931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.971931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.972393] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.972625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.972789] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.973086] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.973357] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.973553] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 7907bac7-663a-465e-a1bb-4840c37713da is going to be created. [ 630.999425] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.999660] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.001563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.001563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.001563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.001563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.612723] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ee2a6999-e3ac-4033-8aa3-26c81f3b812d None None] Enqueued Resource ID: aa8801eb-4bca-4b13-bd9d-bd6bda114f8b with Priority: HIGHEST for action port [ 631.613588] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8801eb-4bca-4b13-bd9d-bd6bda114f8b with Priority: HIGHEST for action port [ 631.613588] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa8801eb-4bca-4b13-bd9d-bd6bda114f8b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.613699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa8801eb-4bca-4b13-bd9d-bd6bda114f8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.613699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa8801eb-4bca-4b13-bd9d-bd6bda114f8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.613974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa8801eb-4bca-4b13-bd9d-bd6bda114f8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.614575] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8801eb-4bca-4b13-bd9d-bd6bda114f8b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.622209] env[65469]: INFO networking_nsxv3.common.synchronization [req-2639c70d-c69c-42f7-a8f7-1de703eb9fd0 req-04c2d030-2e64-48ce-9586-1c1450595093 tempest-ImagesOneServerTestJSON-1305422278 tempest-ImagesOneServerTestJSON-1305422278-project-member] Enqueued Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 631.623642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 631.623642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.623642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.624623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.624623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.624765] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.625943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.625943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.625943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.625943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.625943] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.759139] env[65469]: INFO networking_nsxv3.common.synchronization [req-1abe7517-c52a-4675-baf8-cd361833dd9f req-1a4c7783-f3db-4abd-b13f-6f78883fc428 service nova] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 631.759139] env[65469]: INFO networking_nsxv3.common.synchronization [req-1abe7517-c52a-4675-baf8-cd361833dd9f req-1a4c7783-f3db-4abd-b13f-6f78883fc428 service nova] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 631.759374] env[65469]: INFO networking_nsxv3.common.synchronization [req-1abe7517-c52a-4675-baf8-cd361833dd9f req-1a4c7783-f3db-4abd-b13f-6f78883fc428 service nova] Enqueued Resource ID: 7907bac7-663a-465e-a1bb-4840c37713da with Priority: HIGHEST for action port [ 631.761585] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 631.761774] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 631.761871] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7907bac7-663a-465e-a1bb-4840c37713da with Priority: HIGHEST for action port [ 631.763310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.763483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.763483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.763741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.763829] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.768734] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.768734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.768918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.768972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.769331] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.769331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.769486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.769610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.769694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.769775] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.770792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-7907bac7-663a-465e-a1bb-4840c37713da taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.770951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.770951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.771532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.771532] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7907bac7-663a-465e-a1bb-4840c37713da',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.023580] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 632.023924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.067408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: SUCCESS [ 632.067912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.068011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.068303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.069604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.069604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.069604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.069832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.069942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.070756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.070879] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.117049] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa8801eb-4bca-4b13-bd9d-bd6bda114f8b [ 632.117049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.117049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.117049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.117495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.117495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.117600] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa8801eb-4bca-4b13-bd9d-bd6bda114f8b already deleted. [ 632.117646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa8801eb-4bca-4b13-bd9d-bd6bda114f8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.128843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.128843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.129133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.129133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.129291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.129371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.129481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.129542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.129711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.129827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.129983] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d already deleted. [ 632.130252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.179980] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.180301] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.180508] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.180966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.181257] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.181506] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.181676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.181959] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.182158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.183134] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.183134] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.183134] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.183134] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.183134] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.183134] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.183450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.215424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.215706] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.215706] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.215851] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.216200] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.216402] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.216524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.218452] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.218593] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473c4adc-ea2c-4fc4-b852-59b6ddb44c07',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.276451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.276608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.276804] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.280121] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7907bac7-663a-465e-a1bb-4840c37713da with status ACTIVE [ 632.280121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.280121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.280121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.280424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.280424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.280581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.280646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.281271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.281271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.281271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.281271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.281536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.281536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.281536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.281641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.281641] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7907bac7-663a-465e-a1bb-4840c37713da is going to be updated. [ 632.304622] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.304773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.304945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.305082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.305270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.305410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7907bac7-663a-465e-a1bb-4840c37713da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.573957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.574150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.574150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.574448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.574506] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.574598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.574598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.574827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.574874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.574960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.575287] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.575571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.575647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.575961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.575961] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.576093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.576093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.576230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.576319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.576369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.576460] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.721260] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.721405] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.721529] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.721823] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.721973] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.722138] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 not found, creating... [ 632.722438] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.722577] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.722690] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.722909] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.723050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.723341] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.723501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.723610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.723832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.723930] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.724081] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 is going to be created. [ 632.746121] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.746467] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.746467] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.746708] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.746925] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.747222] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.779420] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.079031] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b72348dc-32e6-4663-85f1-f411e222a7a4: rpc.has_security_group_logging(os_id): False [ 633.108754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.109140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.109140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.109297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.109414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.109700] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.109842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.109954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.110225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.110333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.110523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.110626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.111147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.111147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.111147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.111147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.111342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.111342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.111411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.111446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.111536] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 is going to be created. [ 633.183857] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.184018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.184083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.185131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.185433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.195868] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: IN_PROGRESS for 2s [ 633.283141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.283141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.283141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.283346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.283379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.283611] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be created. [ 633.323480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.323674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.323728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.323950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.324971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.340037] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: UNINITIALIZED for 2s [ 633.472032] env[65469]: INFO networking_nsxv3.common.synchronization [req-2639c70d-c69c-42f7-a8f7-1de703eb9fd0 req-de23ba87-a7c3-430e-8817-49348308672a service nova] Enqueued Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_rules [ 633.472032] env[65469]: INFO networking_nsxv3.common.synchronization [req-2639c70d-c69c-42f7-a8f7-1de703eb9fd0 req-de23ba87-a7c3-430e-8817-49348308672a service nova] Enqueued Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 633.472032] env[65469]: INFO networking_nsxv3.common.synchronization [req-2639c70d-c69c-42f7-a8f7-1de703eb9fd0 req-de23ba87-a7c3-430e-8817-49348308672a service nova] Enqueued Resource ID: 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 with Priority: HIGHEST for action port [ 633.472818] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_rules [ 633.472990] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 633.473168] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 with Priority: HIGHEST for action port [ 633.473587] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.473827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.476904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.477348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.477500] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.478721] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.478910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.479134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.479795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.480256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.480466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.480562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.480763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.480878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.480994] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.482997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.483777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.483912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.484127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.484189] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473c4adc-ea2c-4fc4-b852-59b6ddb44c07',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.906419] env[65469]: INFO networking_nsxv3.common.synchronization [None req-be9682f8-22c5-4983-beca-dd4a3760b027 None None] Enqueued Resource ID: eca0ac41-1b6f-4690-bbaa-435da89dc8c4 with Priority: HIGHEST for action port [ 633.907110] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eca0ac41-1b6f-4690-bbaa-435da89dc8c4 with Priority: HIGHEST for action port [ 633.907519] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-eca0ac41-1b6f-4690-bbaa-435da89dc8c4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.907651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eca0ac41-1b6f-4690-bbaa-435da89dc8c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.907730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eca0ac41-1b6f-4690-bbaa-435da89dc8c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.907974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eca0ac41-1b6f-4690-bbaa-435da89dc8c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.908112] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eca0ac41-1b6f-4690-bbaa-435da89dc8c4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.987607] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.987935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.988632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.989815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 with status ACTIVE [ 633.989815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.990092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.990092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.990227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.990375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.990486] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.990694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.990694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.990896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.990990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.991128] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.992265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.992265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.992265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.992265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.992265] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 473c4adc-ea2c-4fc4-b852-59b6ddb44c07 is going to be updated. [ 634.018690] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.018929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.018929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.019144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.019625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.019992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473c4adc-ea2c-4fc4-b852-59b6ddb44c07" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.413315] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eca0ac41-1b6f-4690-bbaa-435da89dc8c4 [ 634.413315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.413315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.413315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.413626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.413626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.413626] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eca0ac41-1b6f-4690-bbaa-435da89dc8c4 already deleted. [ 634.413626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eca0ac41-1b6f-4690-bbaa-435da89dc8c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.489603] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.695744] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9d4eae6-dce2-4654-b30e-af90425a2019 req-2bd8e83a-c92e-4f3f-9cb6-e54249304a88 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 634.696502] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 634.696803] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.696803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.696803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.697064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.698905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.698905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.698905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.698905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.698905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.698905] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.883293] env[65469]: INFO networking_nsxv3.common.synchronization [req-cb148bc6-d629-43e1-9885-e8dbee91a4cb req-0d3fb09e-d94b-4791-b307-f174ef690a5f tempest-SecurityGroupRulesNegativeTestJSON-941177129 tempest-SecurityGroupRulesNegativeTestJSON-941177129-project-member] Enqueued Resource ID: 90a51516-bd26-4405-8e69-293a81e06733 with Priority: HIGHEST for action security_group_rules [ 634.883811] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a51516-bd26-4405-8e69-293a81e06733 with Priority: HIGHEST for action security_group_rules [ 634.885581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90a51516-bd26-4405-8e69-293a81e06733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.885726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.885784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.886039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.886128] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90a51516-bd26-4405-8e69-293a81e06733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.998638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.998866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.998866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.999124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.999216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.999313] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d is going to be created. [ 635.034179] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.034423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.034423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.034622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.034789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.048300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: UNINITIALIZED for 2s [ 635.201735] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.210557] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: SUCCESS [ 635.210557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.225809] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.226216] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.226424] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.226718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.227369] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.227579] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.227725] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.228185] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.228372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.228595] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.228705] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.228810] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.228913] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.229023] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.229157] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.229246] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.260559] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.260559] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.260782] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.260977] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.261475] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.261709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.261863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.262885] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.263364] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb73a9e2-ee59-4c1e-83c3-d47310e3475f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.371992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 635.372297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.372511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.373351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.373757] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.373965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.374305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.374509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.374632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.374929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.375095] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.415695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.415695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.415695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.416248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.416248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.416248] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90a51516-bd26-4405-8e69-293a81e06733 already deleted. [ 635.416445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.592670] env[65469]: INFO networking_nsxv3.common.synchronization [req-67273d7e-b908-4070-bee1-c206ab0aca8c req-7cbfc39b-fd3d-4dc0-a685-3278e1fde5c5 tempest-ServerExternalEventsTest-1681596344 tempest-ServerExternalEventsTest-1681596344-project-member] Enqueued Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 635.592966] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGHEST for action security_group_members [ 635.593552] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.593552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.593552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.593883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.593883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.593883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.593883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.594224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.594224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.594224] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.703742] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.767906] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.768085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.768197] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.768513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.768742] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.768986] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port bb73a9e2-ee59-4c1e-83c3-d47310e3475f not found, creating... [ 635.769495] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.769702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.769891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.770151] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.770291] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.770574] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.770734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.770835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.771049] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.771192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.771336] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: bb73a9e2-ee59-4c1e-83c3-d47310e3475f is going to be created. [ 635.796403] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.796861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.796861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.797027] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.797273] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.797524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.878440] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.097036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.097708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.097708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.097708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.097708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.097973] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.098129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.098129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.098322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.098428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.098537] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b is going to be updated. [ 636.136517] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.136728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.136728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.137058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.137058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.152968] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: IN_PROGRESS for 2s [ 636.155049] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7374bed8-cdae-4a3b-914f-41c1d07f2fd4 None None] Enqueued Resource ID: 11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61 with Priority: HIGHEST for action port [ 636.155370] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61 with Priority: HIGHEST for action port [ 636.155712] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.155829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.156287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.156287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.156287] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.208017] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.208308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.208429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.208680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.208803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.208925] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 636.249110] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.249110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.249110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.249110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.249519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.278602] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 636.381445] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e6975d0-2064-42d1-b410-13058e6b3c61: rpc.has_security_group_logging(os_id): False [ 636.422796] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.423169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.423169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.423291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.423473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.424870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.424870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.424870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.424870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.424870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.424870] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be created. [ 636.532024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.532024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.532150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.532455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.532658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.558461] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 636.573525] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9d4eae6-dce2-4654-b30e-af90425a2019 req-e60cecc1-f520-447f-a351-3c053a7c2bcf service nova] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_rules [ 636.573920] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9d4eae6-dce2-4654-b30e-af90425a2019 req-e60cecc1-f520-447f-a351-3c053a7c2bcf service nova] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 636.574500] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9d4eae6-dce2-4654-b30e-af90425a2019 req-e60cecc1-f520-447f-a351-3c053a7c2bcf service nova] Enqueued Resource ID: bb73a9e2-ee59-4c1e-83c3-d47310e3475f with Priority: HIGHEST for action port [ 636.578877] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_rules [ 636.578877] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 636.578877] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb73a9e2-ee59-4c1e-83c3-d47310e3475f with Priority: HIGHEST for action port [ 636.578877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.578877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.578877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.578877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.578877] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.579776] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.579776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.579776] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.579776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.579957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.580099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.580099] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb73a9e2-ee59-4c1e-83c3-d47310e3475f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.658595] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61 [ 636.660126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.660126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.660126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.660126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.660126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.660126] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61 already deleted. [ 636.660126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11f342f0-c9f6-401a-8cd4-6e2d9ac8cf61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.061428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: SUCCESS [ 637.061770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.062036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.062311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.062566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.062704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.062781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.062966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.063075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.063189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.063278] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.082042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.082042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.090160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb73a9e2-ee59-4c1e-83c3-d47310e3475f with status ACTIVE [ 637.090160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.090160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.090160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.090160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.090160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb73a9e2-ee59-4c1e-83c3-d47310e3475f is going to be updated. [ 637.117601] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.117601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.117601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.117601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.117601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.117601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb73a9e2-ee59-4c1e-83c3-d47310e3475f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.567456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.567940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.567940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.567940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.568170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.568170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.568328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.568477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.568477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.568769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.568769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.568769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.569248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.569248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.569248] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.569248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.569604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.569604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.569604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.569834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.569834] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.919956] env[65469]: INFO networking_nsxv3.common.synchronization [req-85162ccf-540c-4b4a-8f6d-6d0178068cc4 req-ea7709eb-7028-4b88-8b63-7b80966f8fe2 tempest-ServersTestFqdnHostnames-603046965 tempest-ServersTestFqdnHostnames-603046965-project-member] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 637.920594] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 637.920917] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.921230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.921351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.921649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.921840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.922025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.922135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.922226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.922331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.922436] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.074510] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5863af48-2574-424a-a51b-dcfeb0d1a63d: rpc.has_security_group_logging(os_id): False [ 638.101569] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.101795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.101795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.102124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.102314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.102540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.102690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.102800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.102942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.103033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.103250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.103428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.103526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.103656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.103769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.103969] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.104123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.104209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.104418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.104616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.104616] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d is going to be created. [ 638.162815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b in Status: SUCCESS [ 638.162973] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b deletion is rescheduled due to dependency. [ 638.163182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.177709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.177914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.177914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.178177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.178338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.190555] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: IN_PROGRESS for 2s [ 638.293894] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.293894] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.293894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.293894] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.426094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.426254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.426539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.426539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.426669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.426826] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.426947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.426988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.427231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.427449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.427579] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 already deleted. [ 638.427829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.450727] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-825" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-825" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-825" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.450727] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.450727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.450727] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.450727] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.450727] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.450727] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.451779] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.451779] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.451779] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.476022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.476277] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.476449] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.476715] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-825" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.477238] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-502bedeb-c9ae-4209-b31d-141abb4b5875 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.477513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.477721] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.478179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.478408] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502bedeb-c9ae-4209-b31d-141abb4b5875',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.575901] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 638.576391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.796278] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.982710] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.986019] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 502bedeb-c9ae-4209-b31d-141abb4b5875 not found, creating... [ 638.986019] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.986019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.986647] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.987475] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.987925] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.988847] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.990014] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.990014] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 502bedeb-c9ae-4209-b31d-141abb4b5875 is going to be created. [ 639.018244] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.019810] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.019810] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.020525] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.020762] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.021170] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.298334] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.770562] env[65469]: INFO networking_nsxv3.common.synchronization [req-85162ccf-540c-4b4a-8f6d-6d0178068cc4 req-270398cd-1532-4f47-971e-9dc1e220e0d6 service nova] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 639.770838] env[65469]: INFO networking_nsxv3.common.synchronization [req-85162ccf-540c-4b4a-8f6d-6d0178068cc4 req-270398cd-1532-4f47-971e-9dc1e220e0d6 service nova] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 639.771101] env[65469]: INFO networking_nsxv3.common.synchronization [req-85162ccf-540c-4b4a-8f6d-6d0178068cc4 req-270398cd-1532-4f47-971e-9dc1e220e0d6 service nova] Enqueued Resource ID: 502bedeb-c9ae-4209-b31d-141abb4b5875 with Priority: HIGHEST for action port [ 639.771743] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_rules [ 639.771890] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 639.771991] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 502bedeb-c9ae-4209-b31d-141abb4b5875 with Priority: HIGHEST for action port [ 639.772283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.772474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.772474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.772695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.772779] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.773835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.774267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.774333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.774614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.774990] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.775181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.775302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.775587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.775721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.775864] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.777565] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-502bedeb-c9ae-4209-b31d-141abb4b5875 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.777699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.777773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.777929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.778027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502bedeb-c9ae-4209-b31d-141abb4b5875',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.801092] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.801324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.801324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.801603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.801603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.801742] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 639.840160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.840368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.840427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.840702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.840863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.857809] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 640.077401] env[65469]: INFO networking_nsxv3.common.synchronization [req-31f8af0e-7201-458c-8aed-4c59b7fbceb4 req-79d5e0fd-a217-4ca7-a976-707053b136c4 tempest-TenantUsagesTestJSON-1997812009 tempest-TenantUsagesTestJSON-1997812009-project-member] Enqueued Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 640.078523] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGHEST for action security_group_members [ 640.078879] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.079040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.079133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.079487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.079487] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.079693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.079693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.079815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.079901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.079998] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.142513] env[65469]: INFO networking_nsxv3.common.synchronization [None req-672e3a36-b8b4-4b31-94c5-bfd48b3e531d None None] Enqueued Resource ID: b712cbef-eba8-476a-872e-40d19d24a8a8 with Priority: HIGHEST for action port [ 640.143048] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b712cbef-eba8-476a-872e-40d19d24a8a8 with Priority: HIGHEST for action port [ 640.143434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b712cbef-eba8-476a-872e-40d19d24a8a8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.143607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b712cbef-eba8-476a-872e-40d19d24a8a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.143711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b712cbef-eba8-476a-872e-40d19d24a8a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.144017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b712cbef-eba8-476a-872e-40d19d24a8a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.144151] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b712cbef-eba8-476a-872e-40d19d24a8a8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.208240] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: SUCCESS [ 640.208240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.280651] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 502bedeb-c9ae-4209-b31d-141abb4b5875 with status ACTIVE [ 640.282183] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.282476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.282592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.282830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.282969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.283211] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.283360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.283406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.283614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.283955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.284179] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.284353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.284459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.284717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.285485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.285485] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 502bedeb-c9ae-4209-b31d-141abb4b5875 is going to be updated. [ 640.288169] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.288889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.289873] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.323350] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.323350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.324456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.324456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.324456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.324456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-502bedeb-c9ae-4209-b31d-141abb4b5875" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.583912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.583912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.583912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.583912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.583912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.583912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.583912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.584349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.584349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.584349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.584349] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 is going to be updated. [ 640.627521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.627521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.627521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.627799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.627957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.642430] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: IN_PROGRESS for 2s [ 640.647426] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b712cbef-eba8-476a-872e-40d19d24a8a8 [ 640.648782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.648782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.648782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.648782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.648782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.649088] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b712cbef-eba8-476a-872e-40d19d24a8a8 already deleted. [ 640.649088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b712cbef-eba8-476a-872e-40d19d24a8a8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.794463] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.302816] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.302816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.302816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.302816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.302816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.302816] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 is going to be created. [ 641.341916] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.343377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.343377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.343377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.343377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.364078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: UNINITIALIZED for 2s [ 641.594253] env[65469]: INFO networking_nsxv3.common.synchronization [req-6471ae8a-4c5d-4f00-a4c9-90a0c7a81e7c req-0153220d-4e0d-4693-be3c-54e5aac7ce70 tempest-FloatingIPsAssociationTestJSON-606961835 tempest-FloatingIPsAssociationTestJSON-606961835-project-member] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 641.594253] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 641.596159] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.596318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.596381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.596590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.597037] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.597037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.597037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.597203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.597203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.597339] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.870508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 641.870952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.871676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.871953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.872293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.872460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.872575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.874297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.874557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.874557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.874694] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.100421] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.335946] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.336218] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.336286] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.336607] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.336962] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.337264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.337353] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.337786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.337786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.337933] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.338049] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.338465] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.338465] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.338465] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.338608] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.338749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.361430] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.361564] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.361709] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.361887] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.362233] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-75319620-7a7c-4730-9491-0436d02a65af taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.362664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.362664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.362898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.363065] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75319620-7a7c-4730-9491-0436d02a65af',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.378118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.378371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.378469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.378718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.379476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.379476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.379476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.379476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.379476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.379739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.379739] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.380909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.380909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.382369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.382369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.382369] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.543620] env[65469]: INFO networking_nsxv3.common.synchronization [None req-f3dcea7b-a4d5-4633-bda4-e31be8276c89 None None] Enqueued Resource ID: 95421956-707d-4f79-ac3c-3e1c0dd7d6b2 with Priority: HIGHEST for action port [ 642.546122] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95421956-707d-4f79-ac3c-3e1c0dd7d6b2 with Priority: HIGHEST for action port [ 642.546122] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-95421956-707d-4f79-ac3c-3e1c0dd7d6b2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.546122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95421956-707d-4f79-ac3c-3e1c0dd7d6b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.546122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95421956-707d-4f79-ac3c-3e1c0dd7d6b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.546122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95421956-707d-4f79-ac3c-3e1c0dd7d6b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.546122] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95421956-707d-4f79-ac3c-3e1c0dd7d6b2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.604932] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.655758] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7663bbf6-b391-494e-9a60-db9d723b0635 in Status: SUCCESS [ 642.655758] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 deletion is rescheduled due to dependency. [ 642.655758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.868675] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.868675] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 75319620-7a7c-4730-9491-0436d02a65af not found, creating... [ 642.868675] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.868675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.869250] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.869250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.869250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.869599] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.870428] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.870716] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 75319620-7a7c-4730-9491-0436d02a65af is going to be created. [ 642.889262] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80280ff5-2173-4569-9e09-d7fdc89693a7: rpc.has_security_group_logging(os_id): False [ 642.908720] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.908720] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.908992] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.910259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.910594] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.910852] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.912656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.912774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.912835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.913582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.913582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.913582] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.913582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.913582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.913839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.913891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.914118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.914796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.914796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.914796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.914796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.914796] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.915032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.915032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.915101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.915134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.915823] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 643.001718] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.001718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.001718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.001718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.001718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.028349] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 643.048032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95421956-707d-4f79-ac3c-3e1c0dd7d6b2 [ 643.048838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.048838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.048838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.048838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.049107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.049107] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95421956-707d-4f79-ac3c-3e1c0dd7d6b2 already deleted. [ 643.049168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95421956-707d-4f79-ac3c-3e1c0dd7d6b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.109497] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.109745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.109818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.109986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.110095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.110197] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be updated. [ 643.152356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.152581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.152633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.152951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.153167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.164484] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 643.375808] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: SUCCESS [ 643.376084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.376338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.376520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.376717] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.376858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.376948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.377200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.377456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.377555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.377655] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.880207] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.041657] env[65469]: INFO networking_nsxv3.common.synchronization [req-6471ae8a-4c5d-4f00-a4c9-90a0c7a81e7c req-e990b121-68d1-44e3-aa39-9b0a0555ce52 service nova] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_rules [ 644.041831] env[65469]: INFO networking_nsxv3.common.synchronization [req-6471ae8a-4c5d-4f00-a4c9-90a0c7a81e7c req-e990b121-68d1-44e3-aa39-9b0a0555ce52 service nova] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 644.041964] env[65469]: INFO networking_nsxv3.common.synchronization [req-6471ae8a-4c5d-4f00-a4c9-90a0c7a81e7c req-e990b121-68d1-44e3-aa39-9b0a0555ce52 service nova] Enqueued Resource ID: 75319620-7a7c-4730-9491-0436d02a65af with Priority: HIGHEST for action port [ 644.042852] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_rules [ 644.043020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 644.043609] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75319620-7a7c-4730-9491-0436d02a65af with Priority: HIGHEST for action port [ 644.043931] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.044072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.044140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.044383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.044467] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.045477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.045563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.046459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-75319620-7a7c-4730-9491-0436d02a65af taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.046459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.046459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.046654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.046654] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75319620-7a7c-4730-9491-0436d02a65af',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.252698] env[65469]: INFO networking_nsxv3.common.synchronization [None req-415b5b5e-2bdd-4d46-aa80-297329dabf8c None None] Enqueued Resource ID: bd5009b3-bde6-4176-b625-ef3739e0219b with Priority: HIGHEST for action port [ 644.253735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5009b3-bde6-4176-b625-ef3739e0219b with Priority: HIGHEST for action port [ 644.254207] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5009b3-bde6-4176-b625-ef3739e0219b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.254389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5009b3-bde6-4176-b625-ef3739e0219b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.254479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5009b3-bde6-4176-b625-ef3739e0219b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.254753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5009b3-bde6-4176-b625-ef3739e0219b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.254842] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5009b3-bde6-4176-b625-ef3739e0219b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.375375] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 644.375570] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 644.376494] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 644.376777] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 644.377135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.377353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.377539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.377726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.378034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.378034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.378195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.378233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.378323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.378422] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.380231] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.381150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.381292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.381480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.381788] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.381788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.381788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.382170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.382170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.382282] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.385062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00: rpc.has_security_group_logging(os_id): False [ 644.408272] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.408503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.408570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.408914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.408914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.409173] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.409350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.409350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.409516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.409516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.409622] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 is going to be created. [ 644.435645] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_rules [ 644.435833] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 644.435952] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 644.436147] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 644.436330] env[65469]: INFO networking_nsxv3.common.synchronization [req-61292204-076d-4843-b078-510c7f033acf req-4dba1574-7e3c-444d-9600-e6f0928902b0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 644.437214] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_rules [ 644.437507] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 644.437596] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 644.437759] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 644.437928] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 644.438574] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.438742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.438847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.439230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.439393] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.441317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.441918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.442085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.442304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.442398] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.446644] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.446810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.446849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.447104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.447217] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98acc2f9-ae60-456e-ac90-5bdb589aa6dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.448773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.448773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.448773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.448773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.482030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.482030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.482030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.482030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.482030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.495798] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: IN_PROGRESS for 2s [ 644.554903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.554903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75319620-7a7c-4730-9491-0436d02a65af with status ACTIVE [ 644.554903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.554903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.554903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.554903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.555512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.555512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.556264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.556264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.556264] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75319620-7a7c-4730-9491-0436d02a65af is going to be updated. [ 644.591337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.591468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.591468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.591654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.591776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.591935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75319620-7a7c-4730-9491-0436d02a65af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.757661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd5009b3-bde6-4176-b625-ef3739e0219b [ 644.758191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.759501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.759501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.759501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.759501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.759501] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd5009b3-bde6-4176-b625-ef3739e0219b already deleted. [ 644.759501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5009b3-bde6-4176-b625-ef3739e0219b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.887306] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.887306] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.949801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.949910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.951145] env[65469]: INFO networking_nsxv3.common.synchronization [req-1fd9b21e-362e-4323-bf3a-482afc1bf94e req-71f126ce-0e35-453d-96ed-ff3558f2a39d tempest-ServerDiagnosticsNegativeTest-1872254845 tempest-ServerDiagnosticsNegativeTest-1872254845-project-member] Enqueued Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 644.951275] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.951368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.951542] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with status ACTIVE [ 644.951711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.952324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.952324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.952324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.952324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.952527] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.952527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.952527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.952650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.952713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.952889] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.953034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.953069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.953190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.953257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.953339] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd is going to be updated. [ 644.954715] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 644.956021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.956021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.956021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.956021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.956288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.956288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.956288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.956413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.956513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.956619] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.026643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.027018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.027208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.027478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.027662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.027875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.051550] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 645.051550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.178026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 645.178026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.178026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.178026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.178554] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.178554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.178554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.178554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.178554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.178771] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.392711] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.393660] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.415277] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.415761] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.415906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.417655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.417655] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.417655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.417655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.417655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.417655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.418207] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.418207] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.421749] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.421749] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.421749] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.421749] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.421749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.453898] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.453898] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.453898] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.453898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.453898] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-5e3883b8-71b7-4363-83d0-486220cc67ae taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.453898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.453898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.453898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.453898] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e3883b8-71b7-4363-83d0-486220cc67ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.460561] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.460561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.460561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.460561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.460561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.460561] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.460996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.460996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.460996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.460996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.461212] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b309be15-6460-49da-bd48-e95c49f1421b already deleted. [ 645.461212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.683799] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.900034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.900034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.900034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.900568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.900568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.900688] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 645.902016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.902178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.902258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.902393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.902538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.902646] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be created. [ 645.940070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.940070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.940070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.940827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.940827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.944909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.945078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.945200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.945377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.945501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.954992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: UNINITIALIZED for 2s [ 645.957071] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.957539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.957803] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.958320] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.958528] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.958702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 5e3883b8-71b7-4363-83d0-486220cc67ae not found, creating... [ 645.959245] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.959379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.959588] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.959917] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.960086] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.960630] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.960835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.961088] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.961301] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.961460] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.961819] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 5e3883b8-71b7-4363-83d0-486220cc67ae is going to be created. [ 645.963705] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 645.987665] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.987902] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.988039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.988728] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.988978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.989250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.995509] env[65469]: INFO networking_nsxv3.common.synchronization [req-de2fa71b-b709-4152-9d91-b935c31efc54 req-c16eac1d-84a4-4a8f-a39e-d503ebe0141c tempest-SecurityGroupRulesNegativeTestJSON-941177129 tempest-SecurityGroupRulesNegativeTestJSON-941177129-project-member] Enqueued Resource ID: 90a51516-bd26-4405-8e69-293a81e06733 with Priority: HIGHEST for action security_group_rules [ 645.996419] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a51516-bd26-4405-8e69-293a81e06733 with Priority: HIGHEST for action security_group_rules [ 645.996898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90a51516-bd26-4405-8e69-293a81e06733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.997181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.997369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.997675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.997819] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90a51516-bd26-4405-8e69-293a81e06733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.188030] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.512653] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: SUCCESS [ 646.512940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.527524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.527524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.527524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.527524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.527524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.527524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90a51516-bd26-4405-8e69-293a81e06733 already deleted. [ 646.527524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90a51516-bd26-4405-8e69-293a81e06733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.692642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.692642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.692642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.692642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.692642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.692642] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be updated. [ 646.739183] env[65469]: INFO networking_nsxv3.common.synchronization [None req-2a97dcf6-d835-44c3-8f3f-e4e65c536c67 None None] Enqueued Resource ID: e487f3c7-1d61-4eeb-9aa8-723f6d885746 with Priority: HIGHEST for action port [ 646.739183] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e487f3c7-1d61-4eeb-9aa8-723f6d885746 with Priority: HIGHEST for action port [ 646.739183] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e487f3c7-1d61-4eeb-9aa8-723f6d885746 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.739771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e487f3c7-1d61-4eeb-9aa8-723f6d885746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.740037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e487f3c7-1d61-4eeb-9aa8-723f6d885746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.740466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e487f3c7-1d61-4eeb-9aa8-723f6d885746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.741095] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e487f3c7-1d61-4eeb-9aa8-723f6d885746',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.750536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.750935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.751122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.751446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.751728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.772286] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 646.785047] env[65469]: INFO networking_nsxv3.common.synchronization [req-1fd9b21e-362e-4323-bf3a-482afc1bf94e req-6644e952-8eac-483a-bd1e-08fc4212325c service nova] Enqueued Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_rules [ 646.786281] env[65469]: INFO networking_nsxv3.common.synchronization [req-1fd9b21e-362e-4323-bf3a-482afc1bf94e req-6644e952-8eac-483a-bd1e-08fc4212325c service nova] Enqueued Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 646.786492] env[65469]: INFO networking_nsxv3.common.synchronization [req-1fd9b21e-362e-4323-bf3a-482afc1bf94e req-6644e952-8eac-483a-bd1e-08fc4212325c service nova] Enqueued Resource ID: 5e3883b8-71b7-4363-83d0-486220cc67ae with Priority: HIGHEST for action port [ 646.787220] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_rules [ 646.788576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 646.788576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3883b8-71b7-4363-83d0-486220cc67ae with Priority: HIGHEST for action port [ 646.789027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.790604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.790604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.790604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.790604] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.791132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.791225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.791495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.791612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.791698] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.792538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.792538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.792709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.792794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.792891] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.794503] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e3883b8-71b7-4363-83d0-486220cc67ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.794503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.794503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.794915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.794915] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e3883b8-71b7-4363-83d0-486220cc67ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.952634] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f118c45-af89-4b3f-bec3-45279c09b3bf req-3ed45905-c773-4295-b9af-ff121b911c63 tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 646.952634] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 646.952634] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.952634] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.952634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.952634] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.246885] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e487f3c7-1d61-4eeb-9aa8-723f6d885746 [ 647.247141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.247289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.247371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.247624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.247716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.247815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e487f3c7-1d61-4eeb-9aa8-723f6d885746 already deleted. [ 647.247919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e487f3c7-1d61-4eeb-9aa8-723f6d885746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.299295] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.301474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.301474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.301474] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e3883b8-71b7-4363-83d0-486220cc67ae with status ACTIVE [ 647.301474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.301848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.301848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.303859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.303859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.304483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.304483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.304573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.304789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.304946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.305956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e3883b8-71b7-4363-83d0-486220cc67ae is going to be updated. [ 647.335621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.335812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.335882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.336125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.336269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.336475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e3883b8-71b7-4363-83d0-486220cc67ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.383561] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-995 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.383754] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.383908] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.384271] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.384521] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.384668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.384776] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.384986] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.385135] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.385332] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.385594] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.385594] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.385671] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.385717] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.385812] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.385930] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.414242] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.414419] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.414558] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.414738] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.415417] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-768650c5-c8b2-4245-8adb-fe9fa9157db6 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.415417] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.415417] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.415677] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.415924] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('768650c5-c8b2-4245-8adb-fe9fa9157db6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.455793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.455998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.456073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.456302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.456548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.456665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.456794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.456863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.457021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.457165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.457165] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 already deleted. [ 647.457356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.808767] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.832126] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 647.832253] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 647.832418] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 647.832899] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 647.833047] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 647.833145] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 647.833414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.833539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.833605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.833872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.834045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.834139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.834207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.834360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.834445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.834654] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.835604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.835713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.835914] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.836016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.886670] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_rules [ 647.886836] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 647.886960] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_rules [ 647.887099] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 647.887219] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 647.887438] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 647.887574] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d5c9203-efec-44c9-85da-0d1818bdaaad req-6d5914c6-26ee-498a-816d-62d37ca04a25 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 647.888095] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_rules [ 647.888233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_rules [ 647.888330] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 647.888422] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with Priority: HIGHEST for action port [ 647.888509] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 647.888595] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 647.888681] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 647.888954] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.889081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.889268] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.889369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.889430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.889745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.889839] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.890685] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.890832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.890956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.891059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.891124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.891279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.891364] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98acc2f9-ae60-456e-ac90-5bdb589aa6dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.892442] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.892557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.892758] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.892924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.893021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.893111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918185] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.918509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.918919] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.919081] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.919238] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 768650c5-c8b2-4245-8adb-fe9fa9157db6 not found, creating... [ 647.919503] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.919656] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.919782] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.920019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.920158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.920435] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.920644] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.920825] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.921143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.921427] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.921543] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 768650c5-c8b2-4245-8adb-fe9fa9157db6 is going to be created. [ 647.943596] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.944668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.944668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.944668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.944668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.945145] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.966401] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 647.966964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.967256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.967529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.967785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.968141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.968141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.968310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.968460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.968649] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.976599] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 647.976814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.976998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.977387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.977566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.977736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.977807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.977966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.978105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.978306] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.313767] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.313767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.313767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.313767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.313767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.313767] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b309be15-6460-49da-bd48-e95c49f1421b is going to be created. [ 648.337938] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.339429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.339429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.339679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.339679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.339822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.352180] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: UNINITIALIZED for 2s [ 648.393950] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98acc2f9-ae60-456e-ac90-5bdb589aa6dd with status ACTIVE [ 648.394205] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.394349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.394427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.394627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.394719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.394898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.395013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.395080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.395218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.395352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.395490] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.395631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.395692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.395833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.395904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.395988] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98acc2f9-ae60-456e-ac90-5bdb589aa6dd is going to be updated. [ 648.397360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.397503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.417856] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.418064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.418064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.418249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.418453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.418619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98acc2f9-ae60-456e-ac90-5bdb589aa6dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.471224] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.479898] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.669750] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f118c45-af89-4b3f-bec3-45279c09b3bf req-46f95f5c-888b-4f8e-a37c-0634dab1f118 service nova] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 648.669750] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f118c45-af89-4b3f-bec3-45279c09b3bf req-46f95f5c-888b-4f8e-a37c-0634dab1f118 service nova] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 648.672213] env[65469]: INFO networking_nsxv3.common.synchronization [req-2f118c45-af89-4b3f-bec3-45279c09b3bf req-46f95f5c-888b-4f8e-a37c-0634dab1f118 service nova] Enqueued Resource ID: 768650c5-c8b2-4245-8adb-fe9fa9157db6 with Priority: HIGHEST for action port [ 648.675719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 648.675719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 648.675719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768650c5-c8b2-4245-8adb-fe9fa9157db6 with Priority: HIGHEST for action port [ 648.675719] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.675719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.675719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.675719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.675719] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.676708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.677538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.678633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.678633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.678633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.679159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.679159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.679159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.679626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.679626] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.680514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-768650c5-c8b2-4245-8adb-fe9fa9157db6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.680994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.680994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.681430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.682318] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('768650c5-c8b2-4245-8adb-fe9fa9157db6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.787143] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 648.789570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.789570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.789570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.789570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.789570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.789570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.789886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.789886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.789949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.790227] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.842751] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.977444] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.982949] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.185498] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.188226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.188226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.188226] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 768650c5-c8b2-4245-8adb-fe9fa9157db6 with status ACTIVE [ 649.188226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.188226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.188226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.188725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.188897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.189187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.190450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.190450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.191596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.191596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.191596] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 768650c5-c8b2-4245-8adb-fe9fa9157db6 is going to be updated. [ 649.226448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.226659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.229238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.229238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.229238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.229238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-768650c5-c8b2-4245-8adb-fe9fa9157db6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.292665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.292907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.293152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.293387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.293715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.294079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.294079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.294534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.294834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.295143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.295843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.296183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.296279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.296519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.296812] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.297031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.297180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.297504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.297641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.297853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.297988] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.347027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.347027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.347027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.347027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.347027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.347027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 is going to be created. [ 649.377661] env[65469]: INFO networking_nsxv3.common.synchronization [req-aaf84cca-d039-488c-a809-e8f25e8eafd6 req-8f72952e-8112-454f-b57a-491a07e29017 tempest-ServerDiagnosticsTest-589060635 tempest-ServerDiagnosticsTest-589060635-project-member] Enqueued Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 649.378856] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 649.379342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.379595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.379595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.379905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.380071] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.380256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.380320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.380567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.380654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.380775] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.386720] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.386918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.387035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.387362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.387854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.405174] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: UNINITIALIZED for 2s [ 649.477107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.477265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.477333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.477601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.477735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.477838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be updated. [ 649.488583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.488776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.488874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.489161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.489277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.489429] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 649.534591] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.534865] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.534865] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.535216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.535380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.549825] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.550030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.550117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.550874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.550874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.553798] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 649.563883] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 649.699221] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.772263] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.772263] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.772263] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.772263] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.772263] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.773139] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.773593] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.774164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.775079] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.775079] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.775079] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.775079] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.775985] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.775985] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.775985] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.776727] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.803362] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.803362] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.803362] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.803362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.803362] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-49bf9d2d-64fa-450e-8d7e-ab320af52155 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.803362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.803362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.803714] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.804282] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bf9d2d-64fa-450e-8d7e-ab320af52155',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.804904] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b09b8988-0604-4099-985a-5dc6c13cf18b: rpc.has_security_group_logging(os_id): False [ 649.828526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.828741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.828741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.828983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.829174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.829518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.829518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.829518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.829774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.829774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.829932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.829932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.830031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.830140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.830212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.830388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.830477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.830544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.830676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.830743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.830829] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be updated. [ 649.885492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.885710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.885710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.885844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.885888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.886105] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.886219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.886285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.886408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.886505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.886603] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee already deleted. [ 649.886754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.904168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.904400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.904454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.904707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.904903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.918804] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 650.204299] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.204721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.204721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.204721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.204840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.204992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be created. [ 650.232093] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.232362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.232362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.232597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.232909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.244206] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: UNINITIALIZED for 2s [ 650.307259] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.307638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.307817] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.308159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.308323] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.308517] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 49bf9d2d-64fa-450e-8d7e-ab320af52155 not found, creating... [ 650.308972] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.309114] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.309245] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.309504] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.309669] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.310182] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.310299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.310390] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.310622] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.310825] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.310991] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 49bf9d2d-64fa-450e-8d7e-ab320af52155 is going to be created. [ 650.342295] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.342527] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.342572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.343037] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.343169] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.343362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.366029] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: SUCCESS [ 650.366278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.366464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.366688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.366879] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.367014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.367122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.367333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.367425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.367516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.367606] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.870424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.870620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.870668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.870869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.872293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.872454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.872528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.873172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.873295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.873404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.873589] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.873702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.873784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.873956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.874120] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.874258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.874329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.874423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.874515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.874613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.874716] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.082715] env[65469]: INFO networking_nsxv3.common.synchronization [req-aaf84cca-d039-488c-a809-e8f25e8eafd6 req-117b4639-c1dc-44db-9b55-8ba60dba9b1c service nova] Enqueued Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_rules [ 651.082715] env[65469]: INFO networking_nsxv3.common.synchronization [req-aaf84cca-d039-488c-a809-e8f25e8eafd6 req-117b4639-c1dc-44db-9b55-8ba60dba9b1c service nova] Enqueued Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 651.082715] env[65469]: INFO networking_nsxv3.common.synchronization [req-aaf84cca-d039-488c-a809-e8f25e8eafd6 req-117b4639-c1dc-44db-9b55-8ba60dba9b1c service nova] Enqueued Resource ID: 49bf9d2d-64fa-450e-8d7e-ab320af52155 with Priority: HIGHEST for action port [ 651.083318] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_rules [ 651.083318] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 651.083318] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bf9d2d-64fa-450e-8d7e-ab320af52155 with Priority: HIGHEST for action port [ 651.083318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.083589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.083589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.083956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.083956] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.084771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.084926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.085106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.085206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.085352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.085445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.085503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.085639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.085719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.085813] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.087863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bf9d2d-64fa-450e-8d7e-ab320af52155 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.087863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.087863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.087863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.087863] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bf9d2d-64fa-450e-8d7e-ab320af52155',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.377254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b309be15-6460-49da-bd48-e95c49f1421b: rpc.has_security_group_logging(os_id): False [ 651.397840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.398067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.398067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.399853] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.399853] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.399853] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.399853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.400529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.400529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.400529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.400529] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b309be15-6460-49da-bd48-e95c49f1421b is going to be created. [ 651.417285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: SUCCESS [ 651.418335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.418335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.418523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.418924] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.418924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.418924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.419192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.419192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.419284] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.473342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.473342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.473342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.473342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.473342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.484374] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: IN_PROGRESS for 2s [ 651.565308] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 651.565652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.566794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.567073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.567369] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.567470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.567574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.567815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.567912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.568009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.568124] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.569232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.569355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.569572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.569670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.569712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.569833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.570064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.570064] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.590397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.590548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.590704] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.591668] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49bf9d2d-64fa-450e-8d7e-ab320af52155 with status ACTIVE [ 651.591936] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.592085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.592144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.592394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.592498] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.592681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.592800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.593154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.593327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.594043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.594043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.594043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.594043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.594043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.596760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.596760] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49bf9d2d-64fa-450e-8d7e-ab320af52155 is going to be updated. [ 651.596760] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 651.596760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.598392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.598625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.598835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.598953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.599279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.599279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.599279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.599429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.599429] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.605310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.605598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.606426] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.606426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.606426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.606426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.606426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.606426] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.637302] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.637526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.637997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.637997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.638217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.638405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bf9d2d-64fa-450e-8d7e-ab320af52155" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.920887] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.934382] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 651.934647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.074230] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.074230] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.099266] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.102886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.103051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.111214] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.258038] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 652.258324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.258447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.258732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.258943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.259090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.259153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.259324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.259439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.259541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.259647] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.423339] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.580021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.580726] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e0e254f-6737-4701-b8b1-b6906deeb63f: rpc.has_security_group_logging(os_id): False [ 652.599516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.599697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.599771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.600032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.600032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.600266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.600443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.600443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.603460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.603460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.603588] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be created. [ 652.604850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.604973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.605055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.605221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.605303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.605393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee is going to be created. [ 652.614632] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.632197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.632528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.632528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.632691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.632946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.647409] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: UNINITIALIZED for 2s [ 652.670038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.670038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.670275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.670411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.670642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.683972] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 652.762580] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.928020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.928020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.928020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.928020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.928020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.928020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 is going to be updated. [ 652.965822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.965822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.965822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.966113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.966210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.977463] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: IN_PROGRESS for 2s [ 653.082995] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.083311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.083311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.083589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.083663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.083757] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be updated. [ 653.120815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.120815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.120815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.120815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.120815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.122046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.122200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.122262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.122402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.122487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.122577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 653.147535] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 653.176989] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.177102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.177209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.177654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.177654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.191811] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 653.265452] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 641bf348-fb8f-499f-a944-4cb315e55733: rpc.has_security_group_logging(os_id): False [ 653.299404] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.299616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.299721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.299963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.300083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.300367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.300488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.300552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.300710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.300785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.300875] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be created. [ 653.409415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.410018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.424996] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 653.507953] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: SUCCESS [ 653.508228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.876518] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee3dc9ba-a1b3-4006-b3f3-1146ac6575af req-73d75ff7-30c5-49c5-be84-843f0b7ddaf4 tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 653.877457] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 653.879077] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.881395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.881395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.881395] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.317900] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.318179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.318316] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.318638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.318891] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.319059] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.319157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.319369] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.319515] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.319745] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.319851] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.319990] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.320107] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.320196] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.320315] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.320434] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.343052] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.343260] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.343405] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.343537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.343873] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-eefe13d1-b121-4843-b327-43ffb33938ca taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.344317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.344440] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.344752] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.344889] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eefe13d1-b121-4843-b327-43ffb33938ca',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.383421] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.383610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.383710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.385020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.385020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 already deleted. [ 654.385020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.662798] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: SUCCESS [ 654.663237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.663237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.663396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.663538] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.663716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.663823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.664248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.664418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.664555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.664691] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.703062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 654.703224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.703413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.703743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.703977] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.847904] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.848301] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.848445] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.848825] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.848988] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.849159] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port eefe13d1-b121-4843-b327-43ffb33938ca not found, creating... [ 654.849502] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849626] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.850045] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850238] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.850626] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.850801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.850927] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.851208] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.851339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.851481] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: eefe13d1-b121-4843-b327-43ffb33938ca is going to be created. [ 654.877522] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.877816] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.877936] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.878299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.878587] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.878932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.998861] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: SUCCESS [ 654.999252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.999549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.999955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.000241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.000430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.000592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.000862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.000941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.001510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.001510] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.160062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 655.160317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.160488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.160825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.161022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.161229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.161304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.161535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.161659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.161808] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.167662] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.167662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.167852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.168045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.168259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.168412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.168496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.168671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.168774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.168866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.169070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.169171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.169246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.169431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.169584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.169674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.169758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.169919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.170342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.170919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.171043] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.201737] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 655.202045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.202190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.202417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.202629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.202757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.202861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.202971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.203065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.203200] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.207085] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.207229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.438627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 655.438627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.505167] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee3dc9ba-a1b3-4006-b3f3-1146ac6575af req-1e7b6bd1-f2d7-4449-932f-03e82fb07106 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee3dc9ba-a1b3-4006-b3f3-1146ac6575af req-1e7b6bd1-f2d7-4449-932f-03e82fb07106 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee3dc9ba-a1b3-4006-b3f3-1146ac6575af req-1e7b6bd1-f2d7-4449-932f-03e82fb07106 service nova] Enqueued Resource ID: eefe13d1-b121-4843-b327-43ffb33938ca with Priority: HIGHEST for action port [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 655.580022] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eefe13d1-b121-4843-b327-43ffb33938ca with Priority: HIGHEST for action port [ 655.580022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.580022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.580022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.581082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.581082] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.581998] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.582176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.582250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.582438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.582641] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.582770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.582844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.583062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.584378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.584494] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.585356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-eefe13d1-b121-4843-b327-43ffb33938ca taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.586065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.586065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.586065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.586065] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eefe13d1-b121-4843-b327-43ffb33938ca',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.664415] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.673986] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f756a88-e1c6-407c-9a54-9002d0c269ee: rpc.has_security_group_logging(os_id): False [ 655.696850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.697683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.697683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.697683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.697843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.698057] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.698164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.698211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.698363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.698439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.698674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.698801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.698862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.699019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.701243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.701243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.701243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.701243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.701243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.701243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.701243] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee is going to be created. [ 655.705522] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.770168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.770374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.770435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.770631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.770811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.786233] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: IN_PROGRESS for 2s [ 656.007919] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c49bdcf-f8e3-4883-b509-795a54e2f950: rpc.has_security_group_logging(os_id): False [ 656.033864] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.034118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.034207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.034549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.034830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.035246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.035502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.035723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.035909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.035980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.036081] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 is going to be created. [ 656.088028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.088524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.088524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eefe13d1-b121-4843-b327-43ffb33938ca with status ACTIVE [ 656.088838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.089039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.089039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.089713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.091040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.091040] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.091040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.091040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.091363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.091400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.091968] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.092230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.092369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.092610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.092721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.093070] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eefe13d1-b121-4843-b327-43ffb33938ca is going to be updated. [ 656.094860] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.121488] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.121788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.121788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.122186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.122186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.124881] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.124881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.125090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.125222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.125308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.125524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eefe13d1-b121-4843-b327-43ffb33938ca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.136779] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: IN_PROGRESS for 2s [ 656.167827] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.208611] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.599924] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.671183] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.671488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.671488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.671724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.671760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.671874] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be updated. [ 656.709568] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.712023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.712023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.712023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.712023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.713022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.715420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.715420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.715420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.715420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.715420] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 656.730509] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 656.759954] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.759954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.759954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.759954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.759954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.772276] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 657.103239] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.103416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.103416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.105916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.105916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.105916] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be created. [ 657.134434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.134434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.134434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.135403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.135403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.147444] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: UNINITIALIZED for 2s [ 657.809189] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: SUCCESS [ 657.809559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.151209] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: SUCCESS [ 658.151437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.744271] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 658.744271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.744271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.744271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.744271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.744746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.744746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.744746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.744746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.744950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.744950] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.790603] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 658.790893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.791187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.794368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.794368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794368] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.161783] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 659.161783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.162226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.162226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.163123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.163123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.163123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.163123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.163123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.163123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.163123] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.246995] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.298862] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 659.318873] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.319054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.319238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.319385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.319650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.319840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.319999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.320262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.320355] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.320442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.320442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.320597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.320709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.320984] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.321122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.321178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.321408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.321486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.321576] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 659.384836] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.385068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.385068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.385351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.385604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.399936] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 659.666881] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.667176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.667176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.667393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.667668] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.667820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.667920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.668151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.668299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.668454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.668746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.668924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.669047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.669310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.669918] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.670089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.670222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.670485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.670638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.670833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.671048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.750453] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e0e254f-6737-4701-b8b1-b6906deeb63f: rpc.has_security_group_logging(os_id): False [ 659.777745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.777745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.777745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.777745] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be updated. [ 659.869309] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.869309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.870516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.870516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.870516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.903376] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 660.111463] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f973e36-0ac6-4f94-9e79-287c49659e75 req-2ae68a48-d566-4203-ac0e-447487cfeaa2 tempest-ServerActionsV293TestJSON-298286975 tempest-ServerActionsV293TestJSON-298286975-project-member] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 660.114213] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 660.114213] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.114213] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.114213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.114213] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.173945] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 660.193278] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.193457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.193554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.193995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.193995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.194306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.194306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.194306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.194492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.194492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.194711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.194812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.194812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.194955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.195060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.195279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.195525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.195525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.195658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.195658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.195724] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be created. [ 660.272947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.273102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.273208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.273621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.273621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.291704] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 660.409456] env[65469]: INFO networking_nsxv3.common.synchronization [req-09e15d8f-1d89-421e-b8ca-a8bbd96acba5 req-cf9af88b-db88-46d1-8fa4-de89eaf98a1e tempest-VolumesAdminNegativeTest-1212511974 tempest-VolumesAdminNegativeTest-1212511974-project-member] Enqueued Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 660.410023] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGHEST for action security_group_members [ 660.410342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.411264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.411417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.411668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.411863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.412209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.412209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.412209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.412305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.412405] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.506062] env[65469]: INFO networking_nsxv3.common.synchronization [None req-14d411fb-e33d-4c98-a908-6f2ce6ec9a7f None None] Enqueued Resource ID: e453ddd1-7c8e-499a-97b7-f6b22002b305 with Priority: HIGHEST for action port [ 660.506665] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e453ddd1-7c8e-499a-97b7-f6b22002b305 with Priority: HIGHEST for action port [ 660.506982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e453ddd1-7c8e-499a-97b7-f6b22002b305 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.507250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e453ddd1-7c8e-499a-97b7-f6b22002b305" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.507250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e453ddd1-7c8e-499a-97b7-f6b22002b305" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.510198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e453ddd1-7c8e-499a-97b7-f6b22002b305" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.510929] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e453ddd1-7c8e-499a-97b7-f6b22002b305',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.615811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.616424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.616424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.616424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.616424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.616570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.616657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.616719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.616899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.616985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.617089] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae already deleted. [ 660.617162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.915596] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.915767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.915829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.916074] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.916169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.916367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.916512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.916512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.916672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.916749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.916836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 is going to be updated. [ 660.949368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.949579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.949579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.950476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.950476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.965269] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: IN_PROGRESS for 2s [ 661.012608] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e453ddd1-7c8e-499a-97b7-f6b22002b305 [ 661.012901] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.013093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.013170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.013816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.013816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.013816] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e453ddd1-7c8e-499a-97b7-f6b22002b305 already deleted. [ 661.013816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e453ddd1-7c8e-499a-97b7-f6b22002b305" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.413921] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 661.414204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.414353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.414580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.414674] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.448433] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.448878] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-795" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.448878] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-795" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.449856] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-795" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.449856] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.449856] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.450075] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.450171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.450385] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.450594] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.451130] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.451130] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.451130] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.451314] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.452270] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.452762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.479777] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.479922] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.480279] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.480370] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-795" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.480748] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.481415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.481415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.482242] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.482436] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f35103d7-fc18-4448-b8e5-dce1ac9f95d3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.724243] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c35a332a-b4cb-4364-9d9b-cc1df49d02ac None None] Enqueued Resource ID: fc98de34-7199-4ccd-a13d-23a0f83de1da with Priority: HIGHEST for action port [ 661.725758] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc98de34-7199-4ccd-a13d-23a0f83de1da with Priority: HIGHEST for action port [ 661.727813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc98de34-7199-4ccd-a13d-23a0f83de1da taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.727813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc98de34-7199-4ccd-a13d-23a0f83de1da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.727813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc98de34-7199-4ccd-a13d-23a0f83de1da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.728805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc98de34-7199-4ccd-a13d-23a0f83de1da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.728805] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc98de34-7199-4ccd-a13d-23a0f83de1da',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.919701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.919915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.920019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.920281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.920460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.920573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.920639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.920794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.920885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.920976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.921075] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.924389] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 661.924599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.989305] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.989305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port f35103d7-fc18-4448-b8e5-dce1ac9f95d3 not found, creating... [ 661.989305] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.989305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.990136] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.990136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.990136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.990136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.990136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.990136] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: f35103d7-fc18-4448-b8e5-dce1ac9f95d3 is going to be created. [ 662.019576] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.019576] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.020213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.020213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.020578] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.021058] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.233233] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc98de34-7199-4ccd-a13d-23a0f83de1da [ 662.233620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.233903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.233954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.234276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.234427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.234581] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc98de34-7199-4ccd-a13d-23a0f83de1da already deleted. [ 662.234829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc98de34-7199-4ccd-a13d-23a0f83de1da" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.307792] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 662.307792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.409622] env[65469]: INFO networking_nsxv3.common.synchronization [None req-5854ba2e-f814-4758-8828-4d78693d3316 None None] Enqueued Resource ID: be151afe-f2d2-4b28-b9e1-9a3f73e52b8b with Priority: HIGHEST for action port [ 662.410172] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be151afe-f2d2-4b28-b9e1-9a3f73e52b8b with Priority: HIGHEST for action port [ 662.410526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-be151afe-f2d2-4b28-b9e1-9a3f73e52b8b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be151afe-f2d2-4b28-b9e1-9a3f73e52b8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be151afe-f2d2-4b28-b9e1-9a3f73e52b8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.411040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be151afe-f2d2-4b28-b9e1-9a3f73e52b8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.411158] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be151afe-f2d2-4b28-b9e1-9a3f73e52b8b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.426454] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.426777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.426777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.427036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.427112] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.427214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.427258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.428507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.428507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.428507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.428967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.428967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.428967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.428967] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.761541] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f973e36-0ac6-4f94-9e79-287c49659e75 req-60c18707-91ad-4b85-b815-0df282c4bb34 service nova] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 662.761541] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f973e36-0ac6-4f94-9e79-287c49659e75 req-60c18707-91ad-4b85-b815-0df282c4bb34 service nova] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 662.761541] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f973e36-0ac6-4f94-9e79-287c49659e75 req-60c18707-91ad-4b85-b815-0df282c4bb34 service nova] Enqueued Resource ID: f35103d7-fc18-4448-b8e5-dce1ac9f95d3 with Priority: HIGHEST for action port [ 662.762793] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_rules [ 662.763787] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 662.763787] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35103d7-fc18-4448-b8e5-dce1ac9f95d3 with Priority: HIGHEST for action port [ 662.763787] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.764011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.764011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.764913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.764913] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.765534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.765534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.765534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.765705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.765794] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.765875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.765951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.766473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.766558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.766652] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.767825] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.767944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.767987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.768336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.768336] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f35103d7-fc18-4448-b8e5-dce1ac9f95d3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.914270] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be151afe-f2d2-4b28-b9e1-9a3f73e52b8b [ 662.914377] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.914594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.914594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.914970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.914970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.914970] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be151afe-f2d2-4b28-b9e1-9a3f73e52b8b already deleted. [ 662.914970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be151afe-f2d2-4b28-b9e1-9a3f73e52b8b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.934549] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 662.958982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.959198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.959284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.959558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.960193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.960193] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.960193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.960193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.960958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.960958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.962121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.964100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.964100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.964100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.964100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.964100] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 662.976768] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72348dc-32e6-4663-85f1-f411e222a7a4 in Status: SUCCESS [ 662.976968] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 deletion is rescheduled due to dependency. [ 662.977149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.044346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.044579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.044837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.044930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.045366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.067151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 663.272551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.272811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.272959] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.274266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f35103d7-fc18-4448-b8e5-dce1ac9f95d3 with status ACTIVE [ 663.274571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.274754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.274844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.275908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.276139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.276441] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.276618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.276730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.277210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.277381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.277746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.277995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.278117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.278368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.278510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.278656] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f35103d7-fc18-4448-b8e5-dce1ac9f95d3 is going to be updated. [ 663.315981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.316188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.316270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.316801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.316801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.317134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f35103d7-fc18-4448-b8e5-dce1ac9f95d3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.785789] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.792426] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ce4ef8b8-e788-4905-af77-4f23aafca318 None None] Enqueued Resource ID: 4d461c33-73b4-4f97-9d09-bd66a0a667d5 with Priority: HIGHEST for action port [ 663.792797] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d461c33-73b4-4f97-9d09-bd66a0a667d5 with Priority: HIGHEST for action port [ 663.793191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d461c33-73b4-4f97-9d09-bd66a0a667d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d461c33-73b4-4f97-9d09-bd66a0a667d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d461c33-73b4-4f97-9d09-bd66a0a667d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.793662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d461c33-73b4-4f97-9d09-bd66a0a667d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.793740] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d461c33-73b4-4f97-9d09-bd66a0a667d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.290168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.290168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.290168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.290168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.290168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.290168] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae is going to be created. [ 664.301419] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d461c33-73b4-4f97-9d09-bd66a0a667d5 [ 664.301715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.301864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.301930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.302181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.303039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.303039] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d461c33-73b4-4f97-9d09-bd66a0a667d5 already deleted. [ 664.303039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d461c33-73b4-4f97-9d09-bd66a0a667d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.337384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.337384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.337384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.337384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.337384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.348023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: UNINITIALIZED for 2s [ 664.558687] env[65469]: INFO networking_nsxv3.common.synchronization [None req-81a3906d-839a-4e57-b1bb-8e627c7eabc5 None None] Enqueued Resource ID: c23f6469-42b5-49f0-9d4a-a6a47921e620 with Priority: HIGHEST for action port [ 664.559451] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23f6469-42b5-49f0-9d4a-a6a47921e620 with Priority: HIGHEST for action port [ 664.559526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c23f6469-42b5-49f0-9d4a-a6a47921e620 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.559655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c23f6469-42b5-49f0-9d4a-a6a47921e620" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.560159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c23f6469-42b5-49f0-9d4a-a6a47921e620" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.560318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c23f6469-42b5-49f0-9d4a-a6a47921e620" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.560389] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c23f6469-42b5-49f0-9d4a-a6a47921e620',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.062843] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c23f6469-42b5-49f0-9d4a-a6a47921e620 [ 665.063150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.063253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.063324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.063540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.063631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.063725] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c23f6469-42b5-49f0-9d4a-a6a47921e620 already deleted. [ 665.063805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c23f6469-42b5-49f0-9d4a-a6a47921e620" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.081073] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 665.081384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.359589] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: SUCCESS [ 666.360071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.360071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.360283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.360500] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.360605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.360661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.360788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.360879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.360965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.361141] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.866460] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.893908] env[65469]: INFO networking_nsxv3.common.synchronization [req-e47f2258-60b5-49fd-93e6-cee464aa59c7 req-a520ab2d-669d-4f2b-80ea-496865dfc699 tempest-ServersNegativeTestJSON-2024414313 tempest-ServersNegativeTestJSON-2024414313-project-member] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 666.894423] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 666.895349] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.897019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.897192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.897754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.897880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.898070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.898182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.898447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.898657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.898745] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.369181] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 470f3367-e1b6-4e76-8701-774a6b0e92ae: rpc.has_security_group_logging(os_id): False [ 667.392568] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.393388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.393527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.393809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.393930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.394254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.394369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.394429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.394609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.394691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.394828] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae is going to be created. [ 667.404886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.405173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.405271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.405568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.405678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.405885] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.406031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.406067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.406202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.406304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.406398] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 already deleted. [ 667.406482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.472603] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.472814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.472814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.474713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.474713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.492235] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: IN_PROGRESS for 2s [ 667.653637] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.653637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.653637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.653871] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.654203] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.654407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.654548] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.654826] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.655012] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.655230] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.655383] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.655606] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.655766] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.655899] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.656017] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.656191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.680084] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.680297] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.680436] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.680610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.680927] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-d295366b-068f-4aa2-b950-1e6c682e7506 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.681138] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.681268] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.682484] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.682484] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d295366b-068f-4aa2-b950-1e6c682e7506',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.041921] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9493a65d-4420-40bc-9538-914a98b793ac None None] Enqueued Resource ID: 3c76ff2d-3c4e-4df9-8a36-73361f1b1e02 with Priority: HIGHEST for action port [ 668.041921] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c76ff2d-3c4e-4df9-8a36-73361f1b1e02 with Priority: HIGHEST for action port [ 668.041921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c76ff2d-3c4e-4df9-8a36-73361f1b1e02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.041921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c76ff2d-3c4e-4df9-8a36-73361f1b1e02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.041921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c76ff2d-3c4e-4df9-8a36-73361f1b1e02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.041921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c76ff2d-3c4e-4df9-8a36-73361f1b1e02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.041921] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c76ff2d-3c4e-4df9-8a36-73361f1b1e02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.185513] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.185513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.185513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.186217] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.186436] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.186871] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port d295366b-068f-4aa2-b950-1e6c682e7506 not found, creating... [ 668.187555] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.187901] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.188145] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.188484] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.188718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.189100] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.189451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.189492] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.189709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.189896] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.190095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: d295366b-068f-4aa2-b950-1e6c682e7506 is going to be created. [ 668.213114] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.213771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.213771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.213771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.214087] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.214367] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.341846] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c76ff2d-3c4e-4df9-8a36-73361f1b1e02 [ 668.342240] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.342240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.342408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.342616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.342711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.342763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c76ff2d-3c4e-4df9-8a36-73361f1b1e02 already deleted. [ 668.342807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c76ff2d-3c4e-4df9-8a36-73361f1b1e02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.904751] env[65469]: INFO networking_nsxv3.common.synchronization [req-e47f2258-60b5-49fd-93e6-cee464aa59c7 req-be7c7f6a-484a-4c39-bad5-f8ed9740aa56 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 668.905055] env[65469]: INFO networking_nsxv3.common.synchronization [req-e47f2258-60b5-49fd-93e6-cee464aa59c7 req-be7c7f6a-484a-4c39-bad5-f8ed9740aa56 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 668.905055] env[65469]: INFO networking_nsxv3.common.synchronization [req-e47f2258-60b5-49fd-93e6-cee464aa59c7 req-be7c7f6a-484a-4c39-bad5-f8ed9740aa56 service nova] Enqueued Resource ID: d295366b-068f-4aa2-b950-1e6c682e7506 with Priority: HIGHEST for action port [ 668.905286] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 668.905415] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 668.905506] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d295366b-068f-4aa2-b950-1e6c682e7506 with Priority: HIGHEST for action port [ 668.906565] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.906565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.906693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.906990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.907089] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.908305] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.908412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.908469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.908692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.908897] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.908952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.909061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.909256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.909337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.909428] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.910177] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d295366b-068f-4aa2-b950-1e6c682e7506 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.910321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.910360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.910488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.910575] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d295366b-068f-4aa2-b950-1e6c682e7506',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.389061] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a2c09192-1227-41f1-b0cf-b1b97b7e0f11 None None] Enqueued Resource ID: 6eefffc2-6f55-495f-b7d7-b3a99dbe8356 with Priority: HIGHEST for action port [ 669.389649] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eefffc2-6f55-495f-b7d7-b3a99dbe8356 with Priority: HIGHEST for action port [ 669.389979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eefffc2-6f55-495f-b7d7-b3a99dbe8356 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.390116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eefffc2-6f55-495f-b7d7-b3a99dbe8356" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.390182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eefffc2-6f55-495f-b7d7-b3a99dbe8356" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.390436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eefffc2-6f55-495f-b7d7-b3a99dbe8356" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.390524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eefffc2-6f55-495f-b7d7-b3a99dbe8356',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.412341] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.412498] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.412770] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.413496] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d295366b-068f-4aa2-b950-1e6c682e7506 with status ACTIVE [ 669.413680] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.413752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.413791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.414016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.414116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.414279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.414375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.414463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.414759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.414759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.415967] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.415967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.415967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.415967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.415967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.416300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d295366b-068f-4aa2-b950-1e6c682e7506 is going to be updated. [ 669.439755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.440707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.440868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.441242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.442067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.442067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.508569] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: SUCCESS [ 669.508854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.893061] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eefffc2-6f55-495f-b7d7-b3a99dbe8356 [ 669.893305] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.893485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.893574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.893718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.893822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.893891] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eefffc2-6f55-495f-b7d7-b3a99dbe8356 already deleted. [ 669.893970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eefffc2-6f55-495f-b7d7-b3a99dbe8356" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.920028] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.983381] env[65469]: INFO networking_nsxv3.common.synchronization [req-d5ed38a8-ed31-4f6a-a056-80d6c298fea4 req-c2d0dbee-b3f1-4e2d-99f4-0d11973c166c tempest-ServerDiagnosticsNegativeTest-1872254845 tempest-ServerDiagnosticsNegativeTest-1872254845-project-member] Enqueued Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 669.984936] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGHEST for action security_group_members [ 669.984936] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.984936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.984936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.984936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.984936] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.985743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.985743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.985743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.985743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.985743] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.426870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.426870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.428122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.428880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.429045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.429149] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be created. [ 670.459077] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.459077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.459278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.459354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.459984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.475533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: UNINITIALIZED for 2s [ 670.487330] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.488408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.488408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.488408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.488408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.488408] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.488691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.488691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.492172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.492172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.492172] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b309be15-6460-49da-bd48-e95c49f1421b is going to be updated. [ 670.497368] env[65469]: INFO networking_nsxv3.common.synchronization [req-72d6b49d-a2e7-4b4f-a503-3883eb56e8c6 req-edea9373-d78e-49be-86f9-e6ec879c311a tempest-ImagesNegativeTestJSON-585475248 tempest-ImagesNegativeTestJSON-585475248-project-member] Enqueued Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 670.499253] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 670.499253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.499514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.499514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.499762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.499945] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.500104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.500160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.500325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.500444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.500552] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.539089] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.542541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.542664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.542915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.543250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.552628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: IN_PROGRESS for 2s [ 671.006493] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.006793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.006793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.007196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.007196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.007333] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.007430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.007430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.007774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.007839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.007939] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 already deleted. [ 671.008031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.272451] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.272671] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-555" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.272802] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-555" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.273171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-555" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.273552] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.273841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.273979] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.274289] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.274436] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.274836] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.274963] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.275083] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.275188] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.275294] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.275552] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.275727] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.300711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.300908] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.301030] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.301202] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-555" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.301625] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.301805] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.302341] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.302769] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.303129] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f1c26c9-8168-42e8-8c5b-fc042cc171c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.805636] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.805861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.805978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.806269] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.806469] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.806620] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 not found, creating... [ 671.806891] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.807057] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.807368] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.807692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.807692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.807967] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.809559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.809559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.809559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.809559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.809784] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 is going to be created. [ 671.824207] env[65469]: INFO networking_nsxv3.common.synchronization [None req-83681ab6-e0ff-402f-86d6-4fc3d68860e5 None None] Enqueued Resource ID: 2e4d9817-7d3b-4541-964b-cea469077e53 with Priority: HIGHEST for action port [ 671.825210] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d9817-7d3b-4541-964b-cea469077e53 with Priority: HIGHEST for action port [ 671.825683] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e4d9817-7d3b-4541-964b-cea469077e53 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.825831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e4d9817-7d3b-4541-964b-cea469077e53" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.825899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e4d9817-7d3b-4541-964b-cea469077e53" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.826162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e4d9817-7d3b-4541-964b-cea469077e53" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.826240] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e4d9817-7d3b-4541-964b-cea469077e53',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.844451] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.844451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.844451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.844451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.844957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.844957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.269423] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ced789a9-2ad0-4cb0-b805-f741fede214e None None] Enqueued Resource ID: de50da9a-fcb0-42c9-83e3-cee037128734 with Priority: HIGHEST for action port [ 672.269988] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de50da9a-fcb0-42c9-83e3-cee037128734 with Priority: HIGHEST for action port [ 672.270316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-de50da9a-fcb0-42c9-83e3-cee037128734 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.270442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de50da9a-fcb0-42c9-83e3-cee037128734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.270507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de50da9a-fcb0-42c9-83e3-cee037128734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.270786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de50da9a-fcb0-42c9-83e3-cee037128734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273880] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de50da9a-fcb0-42c9-83e3-cee037128734',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.328832] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e4d9817-7d3b-4541-964b-cea469077e53 [ 672.331038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.331038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.331038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.331038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.331038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.331038] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e4d9817-7d3b-4541-964b-cea469077e53 already deleted. [ 672.331038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e4d9817-7d3b-4541-964b-cea469077e53" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.487524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.489594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.489594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.489594] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.569748] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b309be15-6460-49da-bd48-e95c49f1421b in Status: SUCCESS [ 672.569980] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b309be15-6460-49da-bd48-e95c49f1421b deletion is rescheduled due to dependency. [ 672.570800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.697650] env[65469]: INFO networking_nsxv3.common.synchronization [req-72d6b49d-a2e7-4b4f-a503-3883eb56e8c6 req-5ea12d68-ad69-4668-87be-7489e5eaa6e2 service nova] Enqueued Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_rules [ 672.697793] env[65469]: INFO networking_nsxv3.common.synchronization [req-72d6b49d-a2e7-4b4f-a503-3883eb56e8c6 req-5ea12d68-ad69-4668-87be-7489e5eaa6e2 service nova] Enqueued Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 672.697918] env[65469]: INFO networking_nsxv3.common.synchronization [req-72d6b49d-a2e7-4b4f-a503-3883eb56e8c6 req-5ea12d68-ad69-4668-87be-7489e5eaa6e2 service nova] Enqueued Resource ID: 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 with Priority: HIGHEST for action port [ 672.698459] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_rules [ 672.698702] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 672.698820] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 with Priority: HIGHEST for action port [ 672.699988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.700136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704147] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.704147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.704147] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.704147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.705321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.705321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.705321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.705321] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f1c26c9-8168-42e8-8c5b-fc042cc171c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.774932] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de50da9a-fcb0-42c9-83e3-cee037128734 [ 672.775173] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.775629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.775629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.775629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.775796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.775796] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de50da9a-fcb0-42c9-83e3-cee037128734 already deleted. [ 672.775900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de50da9a-fcb0-42c9-83e3-cee037128734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.995593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.995593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.995593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.997030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.997030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.997030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.997030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.998913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.998913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.998913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.998913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.998913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.998913] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.023023] env[65469]: INFO networking_nsxv3.common.synchronization [req-302484c9-46d9-4f95-b23b-3d807f15281f req-99c3dd01-e716-4ece-a431-a27b3a781e1b tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 673.023023] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 673.023023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.023023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.023023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.023023] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.213024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.213024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 with status ACTIVE [ 673.213024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.213024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.213024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.213024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.213918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.213918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.213918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.213918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.213918] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f1c26c9-8168-42e8-8c5b-fc042cc171c3 is going to be updated. [ 673.213918] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.248429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.248429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.248429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.248429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.248429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.248429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f1c26c9-8168-42e8-8c5b-fc042cc171c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.502492] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1222eeb9-9dbe-496c-9f03-31010145cde2: rpc.has_security_group_logging(os_id): False [ 673.522131] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.522761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.522956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.523379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.523379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.523982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.523982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.523982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.523982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.524229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.524268] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.524346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.524440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.524656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.524742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.524957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.525107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.525170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.525361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.525462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.525554] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be created. [ 673.527256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.527422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.527495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.527746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.527860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.528108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.528243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.528550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.528550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.528739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.528739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 673.565709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.565709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.565709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.565872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.565872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.577648] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 673.596501] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.596501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.596501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.596501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.596501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.611035] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 673.720546] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.223273] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.223273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.223273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.223553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.223625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.224146] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 is going to be created. [ 674.250637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.250637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.250637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.251115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.251115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.262461] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: UNINITIALIZED for 2s [ 674.794997] env[65469]: INFO networking_nsxv3.common.synchronization [None req-814e3cbc-e03e-41dc-a874-4086876ad680 None None] Enqueued Resource ID: 65ce95e4-b6da-4131-96f8-b8ace7909844 with Priority: HIGHEST for action port [ 674.795704] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ce95e4-b6da-4131-96f8-b8ace7909844 with Priority: HIGHEST for action port [ 674.796059] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-65ce95e4-b6da-4131-96f8-b8ace7909844 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.796293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65ce95e4-b6da-4131-96f8-b8ace7909844" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.796293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65ce95e4-b6da-4131-96f8-b8ace7909844" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.796543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65ce95e4-b6da-4131-96f8-b8ace7909844" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.796639] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65ce95e4-b6da-4131-96f8-b8ace7909844',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.302374] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65ce95e4-b6da-4131-96f8-b8ace7909844 [ 675.302623] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.302763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.302890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.303139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.303228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.303322] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65ce95e4-b6da-4131-96f8-b8ace7909844 already deleted. [ 675.303450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65ce95e4-b6da-4131-96f8-b8ace7909844" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.589772] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 675.589984] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 675.590114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.625825] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 675.626322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.785739] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4152efe3-592a-41ef-b0d6-e926b9e1afcc tempest-ServersTestManualDisk-885771844 tempest-ServersTestManualDisk-885771844-project-member] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 675.785739] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 675.786714] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.787407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.788733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.788733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.788733] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.277020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: SUCCESS [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.277020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.277020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.277020] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.295105] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d261988c-4626-4978-a0de-6702b90a1ae9 tempest-ServersTestManualDisk-885771844 tempest-ServersTestManualDisk-885771844-project-member] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 676.296224] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 676.296776] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.296878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.322734] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.322734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.322734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.323058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.323124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.323174] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c already deleted. [ 676.323248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.324155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.324155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.324155] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.399284] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ef686986-c7e9-4ec8-9ca8-11246ddfbf41 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 676.399975] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 676.400302] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.400774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.401250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.401250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.401250] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.780724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.780952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.780952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.781163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.781324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.781481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.781481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.782236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.782236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.782236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.782236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.782236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.782236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.782457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.782457] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.782530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.782530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.782677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.782735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.782819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.782911] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.845988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.846198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.846271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.846510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.846602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.846724] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c already deleted. [ 676.846829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.923736] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.923912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.924038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.924352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.924429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.924510] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 already deleted. [ 676.924583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.286800] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4678c753-8db4-4c5c-893f-3e320ded5c02: rpc.has_security_group_logging(os_id): False [ 677.302664] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e44694da-6378-401b-966b-c250ea2eaa73 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 677.305485] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 677.305485] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.305485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.305485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.305485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.305485] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.311371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.311537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.311589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.311821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.311886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.312141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.312310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.312310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.312778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.312778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.312778] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.312778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.313079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.313079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.313079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.313252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.313348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.313799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.313799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.313799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.313799] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 is going to be created. [ 677.380162] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.380475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.380539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.381266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.381266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.396815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: IN_PROGRESS for 2s [ 677.767112] env[65469]: INFO networking_nsxv3.common.synchronization [None req-be7cadac-d293-4e1f-a5ed-e88a8d710b99 None None] Enqueued Resource ID: 5cbc9c4b-5a09-46e2-83d9-15aaced9a82f with Priority: HIGHEST for action port [ 677.767112] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cbc9c4b-5a09-46e2-83d9-15aaced9a82f with Priority: HIGHEST for action port [ 677.767112] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cbc9c4b-5a09-46e2-83d9-15aaced9a82f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.767112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cbc9c4b-5a09-46e2-83d9-15aaced9a82f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.767112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cbc9c4b-5a09-46e2-83d9-15aaced9a82f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.767112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cbc9c4b-5a09-46e2-83d9-15aaced9a82f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.767701] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cbc9c4b-5a09-46e2-83d9-15aaced9a82f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.847161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.847161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.847161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.847834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.847943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.848078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 already deleted. [ 677.848594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.272062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cbc9c4b-5a09-46e2-83d9-15aaced9a82f [ 678.272062] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.272062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.272062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.272355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.272355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.272355] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cbc9c4b-5a09-46e2-83d9-15aaced9a82f already deleted. [ 678.272470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cbc9c4b-5a09-46e2-83d9-15aaced9a82f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.839745] env[65469]: INFO networking_nsxv3.common.synchronization [req-6fbc2457-080e-4679-8296-f8f0479419d6 req-3bc71a77-df8d-480b-8085-af06986030bf tempest-ServerDiagnosticsTest-589060635 tempest-ServerDiagnosticsTest-589060635-project-member] Enqueued Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 678.840618] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee with Priority: HIGHEST for action security_group_members [ 678.840981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f756a88-e1c6-407c-9a54-9002d0c269ee taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.841337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.841430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.841665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.841978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.842178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.842257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.842424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.842512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.842632] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f756a88-e1c6-407c-9a54-9002d0c269ee',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.345970] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.346154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.346223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.346450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.346538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.348014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.348014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.348014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.348014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.348014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.348014] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee is going to be updated. [ 679.381364] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.381608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.381803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.382136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.382444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.393122] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: IN_PROGRESS for 2s [ 679.407954] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: SUCCESS [ 679.408196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.893121] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4f09ceb4-6876-45b0-be20-d8621fbc2450 None None] Enqueued Resource ID: ba48da45-a27e-48a0-81d9-650fd6b40f99 with Priority: HIGHEST for action port [ 679.894068] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba48da45-a27e-48a0-81d9-650fd6b40f99 with Priority: HIGHEST for action port [ 679.894068] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba48da45-a27e-48a0-81d9-650fd6b40f99 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.894068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba48da45-a27e-48a0-81d9-650fd6b40f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.894355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba48da45-a27e-48a0-81d9-650fd6b40f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.894355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba48da45-a27e-48a0-81d9-650fd6b40f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.896277] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba48da45-a27e-48a0-81d9-650fd6b40f99',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.398640] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba48da45-a27e-48a0-81d9-650fd6b40f99 [ 680.398921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.399072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.399152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.399359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.399488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.399545] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba48da45-a27e-48a0-81d9-650fd6b40f99 already deleted. [ 680.399596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba48da45-a27e-48a0-81d9-650fd6b40f99" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.048442] env[65469]: INFO networking_nsxv3.common.synchronization [req-68d387b4-7bab-4109-9f93-b976e24bf0da req-177af412-713f-4420-bb4b-013dcebf770f tempest-InstanceActionsTestJSON-381140382 tempest-InstanceActionsTestJSON-381140382-project-member] Enqueued Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 681.050477] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 681.050477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.050477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.050477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.050754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.050937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.051118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.051339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.051607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.051755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.051942] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.404341] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee in Status: SUCCESS [ 681.404341] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f756a88-e1c6-407c-9a54-9002d0c269ee deletion is rescheduled due to dependency. [ 681.404341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f756a88-e1c6-407c-9a54-9002d0c269ee" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.556148] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.556347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.556419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.557036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.557036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.558368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.558368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.558368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.558368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.558368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.558368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 already deleted. [ 681.558368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.567531] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.567770] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-921" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.567897] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-921" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.568220] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-921" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.569092] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.569092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.569092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.569092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.569326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.569326] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.569448] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.569519] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.569614] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.569709] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.569802] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.569920] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.590757] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.590963] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.591146] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.591342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-921" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.591701] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-252ece24-321b-4251-be4b-816553d11818 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.591914] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.592075] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.592430] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.592601] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('252ece24-321b-4251-be4b-816553d11818',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.610247] env[65469]: INFO networking_nsxv3.common.synchronization [req-990a5cad-56d3-40fb-b1c4-75646429c7ca req-ffa84a95-8d20-4ea7-b324-820e586ca55a tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 681.610247] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 681.610447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.610447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.610554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.610736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.610890] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.611045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.611203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.611394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.614095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.614095] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.095572] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.095953] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.096398] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.096524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.096716] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.096868] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 252ece24-321b-4251-be4b-816553d11818 not found, creating... [ 682.097211] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.097411] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.097591] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.097815] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.097959] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.098319] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.098512] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.098614] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.099102] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.099436] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.099562] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 252ece24-321b-4251-be4b-816553d11818 is going to be created. [ 682.114535] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.114535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.114535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.114846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.114846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.115524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.115524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.115524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.115524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.115524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.115524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 682.123134] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.123333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.123461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.123766] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.124067] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.124334] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.144771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.144870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.144909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.145126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.145264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.154651] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 682.905379] env[65469]: INFO networking_nsxv3.common.synchronization [req-68d387b4-7bab-4109-9f93-b976e24bf0da req-10fa524b-145a-4195-b45e-d2cac7900279 service nova] Enqueued Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_rules [ 682.905379] env[65469]: INFO networking_nsxv3.common.synchronization [req-68d387b4-7bab-4109-9f93-b976e24bf0da req-10fa524b-145a-4195-b45e-d2cac7900279 service nova] Enqueued Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 682.905379] env[65469]: INFO networking_nsxv3.common.synchronization [req-68d387b4-7bab-4109-9f93-b976e24bf0da req-10fa524b-145a-4195-b45e-d2cac7900279 service nova] Enqueued Resource ID: 252ece24-321b-4251-be4b-816553d11818 with Priority: HIGHEST for action port [ 682.907219] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_rules [ 682.907219] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 682.907219] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 252ece24-321b-4251-be4b-816553d11818 with Priority: HIGHEST for action port [ 682.907219] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.907564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.907922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.911021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.911021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.911021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.911021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.911021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.912457] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-252ece24-321b-4251-be4b-816553d11818 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.913737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.913954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.914221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.914398] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('252ece24-321b-4251-be4b-816553d11818',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.416413] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.416813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.424045] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.424840] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 252ece24-321b-4251-be4b-816553d11818 with status ACTIVE [ 683.424840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.425025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.425025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.425290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.425336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.425481] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.425578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.425631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.426999] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.426999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.426999] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 252ece24-321b-4251-be4b-816553d11818 is going to be updated. [ 683.462189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.462189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.462189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.462376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.462477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.462629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-252ece24-321b-4251-be4b-816553d11818" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.735792] env[65469]: INFO networking_nsxv3.common.synchronization [req-c37662a3-022f-491f-a987-916d15cbf353 req-328e28c7-be82-490e-af18-bdcd87afa737 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 683.736335] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 683.736648] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.736795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.737113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.737919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.737919] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.737919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.737919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.737919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.737919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.738293] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.935995] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.166671] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 684.166873] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 684.166960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.241191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.243491] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.243491] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f already deleted. [ 684.243491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.422566] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.422898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.424650] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.424917] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.425292] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.425651] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.425651] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.425914] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.426127] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.427490] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.427490] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.427490] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.427490] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.427490] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.427490] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.427490] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.439671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.440373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.440504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.440721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.440807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.440927] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 is going to be created. [ 684.448387] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.448602] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.448763] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.448998] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.449636] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-e2d721d6-b99b-4735-a349-2081571f9c89 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.449849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.450035] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.450634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.450742] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d721d6-b99b-4735-a349-2081571f9c89',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.469331] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.469331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.469331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.469331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.469331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.479368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: UNINITIALIZED for 2s [ 684.954921] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.955507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.955507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.955875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.956463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.956463] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port e2d721d6-b99b-4735-a349-2081571f9c89 not found, creating... [ 684.956789] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.957044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.957249] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.957571] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.957762] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.958336] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.958516] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.958636] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.958977] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.960162] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.960162] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: e2d721d6-b99b-4735-a349-2081571f9c89 is going to be created. [ 684.989484] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.989740] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.989989] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.990405] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.990948] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.991082] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.707540] env[65469]: INFO networking_nsxv3.common.synchronization [req-c37662a3-022f-491f-a987-916d15cbf353 req-4b8144a8-5472-4680-9362-7be5e5031281 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 685.708249] env[65469]: INFO networking_nsxv3.common.synchronization [req-c37662a3-022f-491f-a987-916d15cbf353 req-4b8144a8-5472-4680-9362-7be5e5031281 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 685.708249] env[65469]: INFO networking_nsxv3.common.synchronization [req-c37662a3-022f-491f-a987-916d15cbf353 req-4b8144a8-5472-4680-9362-7be5e5031281 service nova] Enqueued Resource ID: e2d721d6-b99b-4735-a349-2081571f9c89 with Priority: HIGHEST for action port [ 685.708999] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 685.708999] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 685.708999] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d721d6-b99b-4735-a349-2081571f9c89 with Priority: HIGHEST for action port [ 685.709306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.709414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.709472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.709733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.709808] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.710715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.710813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.710873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.711023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.711161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.711258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.711353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.711454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.711557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.711646] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.712987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2d721d6-b99b-4735-a349-2081571f9c89 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.713139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.713197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.713394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.713394] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d721d6-b99b-4735-a349-2081571f9c89',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.217364] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.220136] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.220136] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2d721d6-b99b-4735-a349-2081571f9c89 with status ACTIVE [ 686.220136] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.220136] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.220136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.220850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.221110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.221455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.221674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.221934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.222181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.222353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.222526] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2d721d6-b99b-4735-a349-2081571f9c89 is going to be updated. [ 686.250598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.250598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.250598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.250598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.250598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.250598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2d721d6-b99b-4735-a349-2081571f9c89" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.490366] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: SUCCESS [ 686.490579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.490772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.491082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.491332] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.491403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.491685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.491685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.491685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.493444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.493444] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.724897] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.999673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.999673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.999673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.999673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.999673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.001748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.001748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.001748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.001748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.001748] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.229524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.229524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.229524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.229524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.229524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.229524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be created. [ 687.256822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.257814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.257814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.257814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.257814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.269014] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: UNINITIALIZED for 2s [ 687.504926] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5faeab0c-fd4f-463f-b917-048fa4f0ebd1: rpc.has_security_group_logging(os_id): False [ 687.529788] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.529788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.529788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.530098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.530098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.530196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.530261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.530302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.530427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.530508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.530676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.530769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.530831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.530967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.531051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.531226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.531317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.531377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.531513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.531586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.531668] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 is going to be created. [ 687.591115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.591423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.591423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.591570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.591764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.605537] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: IN_PROGRESS for 2s [ 688.238201] env[65469]: INFO networking_nsxv3.common.synchronization [req-0a97e9e2-871c-403b-aeea-8b12522e1c2f req-a4dc945f-00e2-46c1-9979-0203f62e343b tempest-FloatingIPsAssociationNegativeTestJSON-886561089 tempest-FloatingIPsAssociationNegativeTestJSON-886561089-project-member] Enqueued Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 688.238493] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 688.238996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.238996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.238996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.239245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.239540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.239540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.239540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.239738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.239738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.239803] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.720075] env[65469]: INFO networking_nsxv3.common.synchronization [None req-76c3ce2a-077e-4d20-92a7-6d879de8f940 None None] Enqueued Resource ID: a397946b-a123-44e0-b45e-f5a80e0581b7 with Priority: HIGHEST for action port [ 688.720663] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a397946b-a123-44e0-b45e-f5a80e0581b7 with Priority: HIGHEST for action port [ 688.720979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a397946b-a123-44e0-b45e-f5a80e0581b7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.721124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a397946b-a123-44e0-b45e-f5a80e0581b7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.721193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a397946b-a123-44e0-b45e-f5a80e0581b7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.721762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a397946b-a123-44e0-b45e-f5a80e0581b7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.721762] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a397946b-a123-44e0-b45e-f5a80e0581b7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.743177] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.743366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.743415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.743650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.743737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.743897] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.743999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.744075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.744318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.744318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.744436] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c already deleted. [ 688.744545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.763204] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-963 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.763426] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-963" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.763497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-963" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.764224] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-963" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.764494] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.764649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.764763] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.764982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.765162] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.765365] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.765509] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.765579] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.765687] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.765812] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.765915] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.766055] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.790021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.790224] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.790364] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.790543] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-963" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.790959] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-aba5f608-9da3-40c7-a4f5-2cb368717b20 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.791201] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.791346] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.791693] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.791851] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba5f608-9da3-40c7-a4f5-2cb368717b20',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.225877] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a397946b-a123-44e0-b45e-f5a80e0581b7 [ 689.226052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.226151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.226258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.226444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.226535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.226631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a397946b-a123-44e0-b45e-f5a80e0581b7 already deleted. [ 689.226720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a397946b-a123-44e0-b45e-f5a80e0581b7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.290768] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.290768] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.290768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.290768] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.296040] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.296461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.296812] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.298806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.299238] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.299238] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port aba5f608-9da3-40c7-a4f5-2cb368717b20 not found, creating... [ 689.299497] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.299649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.299771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.300038] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.300185] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.300470] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.300625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.300736] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.300956] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.301097] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.301232] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: aba5f608-9da3-40c7-a4f5-2cb368717b20 is going to be created. [ 689.330045] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.330276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.330276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.330505] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.330726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.330949] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.620105] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: SUCCESS [ 689.620363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.793725] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.794578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.794578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.794578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.794578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.794815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.794815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.794894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.794965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.795066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.795230] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.795317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.795379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.795520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.795653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.795742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.795799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.795929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.796037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.796096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.796184] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.148037] env[65469]: INFO networking_nsxv3.common.synchronization [req-0a97e9e2-871c-403b-aeea-8b12522e1c2f req-beeae985-f212-4627-b73e-78e95e4ca0e7 service nova] Enqueued Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_rules [ 690.148271] env[65469]: INFO networking_nsxv3.common.synchronization [req-0a97e9e2-871c-403b-aeea-8b12522e1c2f req-beeae985-f212-4627-b73e-78e95e4ca0e7 service nova] Enqueued Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 690.148357] env[65469]: INFO networking_nsxv3.common.synchronization [req-0a97e9e2-871c-403b-aeea-8b12522e1c2f req-beeae985-f212-4627-b73e-78e95e4ca0e7 service nova] Enqueued Resource ID: aba5f608-9da3-40c7-a4f5-2cb368717b20 with Priority: HIGHEST for action port [ 690.148928] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_rules [ 690.149337] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 690.149440] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba5f608-9da3-40c7-a4f5-2cb368717b20 with Priority: HIGHEST for action port [ 690.149746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.149911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.149998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.150411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.150411] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.152315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.152504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.152731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.152869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.153088] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.153474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.153474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.153606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.153826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.154186] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.155311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba5f608-9da3-40c7-a4f5-2cb368717b20 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.155527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.155651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.155861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.156340] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba5f608-9da3-40c7-a4f5-2cb368717b20',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.300510] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 690.321850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.322239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.322420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.322718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.322914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.323259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.323490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.323651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.323909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.324097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.324372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.324594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.324738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.324982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.325178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.325477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.326309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.326309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.326309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.326309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.326309] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be created. [ 690.476790] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.476790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.476790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.476790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.476790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.489948] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 690.658974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.660360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.660360] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.661079] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba5f608-9da3-40c7-a4f5-2cb368717b20 with status ACTIVE [ 690.661274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.661867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.661867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.661867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.661867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.662082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.662177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.662233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.662718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.662718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.662877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.662877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.663628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.663628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.663628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.663628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba5f608-9da3-40c7-a4f5-2cb368717b20 is going to be updated. [ 690.672478] env[65469]: INFO networking_nsxv3.common.synchronization [req-8d0d15ab-d82a-40e7-b269-6673af94521e req-4a3c7181-6f58-4d2c-bf98-84c56796ff9a tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 690.673206] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 690.674897] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.674897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.674897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.674897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.675165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.675246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.675314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.675703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.675703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.675841] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.691286] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.691434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.691481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.692217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.692217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.692217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba5f608-9da3-40c7-a4f5-2cb368717b20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.143660] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.143918] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.144253] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.144360] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.144685] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.144890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.145021] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.145917] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.145917] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.145917] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.146180] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.146376] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.146464] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.146576] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.146700] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.146838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.169087] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.172251] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.175171] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.175171] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.175171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.175171] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-177baf52-9490-4cc2-ac62-80b8365fd3b9 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.175171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.175171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.175171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.175171] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177baf52-9490-4cc2-ac62-80b8365fd3b9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.180671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.180864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.180946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.181179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.181273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.181475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.181600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.181653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.181786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.181876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.181972] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 691.215047] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.215308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.215308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.215471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.215590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.227896] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 691.672052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.672052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.672052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.672052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.672052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.672052] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c is going to be created. [ 691.677251] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.677586] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.677823] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.678200] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.678433] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.678679] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 177baf52-9490-4cc2-ac62-80b8365fd3b9 not found, creating... [ 691.679104] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.679353] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.679521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.679844] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.680078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.680480] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.680685] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.680834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.681078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.681298] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.681342] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 177baf52-9490-4cc2-ac62-80b8365fd3b9 is going to be created. [ 691.701982] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.702271] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.702414] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.702604] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.702826] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.703066] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.704635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.704911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.704911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.705069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.705138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.716653] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: UNINITIALIZED for 2s [ 692.071991] env[65469]: INFO networking_nsxv3.common.synchronization [None req-f3fe8e5b-2dfe-476b-8058-8fe677ed0edc None None] Enqueued Resource ID: fc36c0b7-9863-4636-8c38-bba87eaf7e55 with Priority: HIGHEST for action port [ 692.072958] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc36c0b7-9863-4636-8c38-bba87eaf7e55 with Priority: HIGHEST for action port [ 692.072958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc36c0b7-9863-4636-8c38-bba87eaf7e55 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.072958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc36c0b7-9863-4636-8c38-bba87eaf7e55" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.073389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc36c0b7-9863-4636-8c38-bba87eaf7e55" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.073389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc36c0b7-9863-4636-8c38-bba87eaf7e55" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.073389] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc36c0b7-9863-4636-8c38-bba87eaf7e55',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.455019] env[65469]: INFO networking_nsxv3.common.synchronization [req-8d0d15ab-d82a-40e7-b269-6673af94521e req-ea27b1d0-6bea-49db-8d86-abe8f234e0c2 service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 692.455019] env[65469]: INFO networking_nsxv3.common.synchronization [req-8d0d15ab-d82a-40e7-b269-6673af94521e req-ea27b1d0-6bea-49db-8d86-abe8f234e0c2 service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 692.455019] env[65469]: INFO networking_nsxv3.common.synchronization [req-8d0d15ab-d82a-40e7-b269-6673af94521e req-ea27b1d0-6bea-49db-8d86-abe8f234e0c2 service nova] Enqueued Resource ID: 177baf52-9490-4cc2-ac62-80b8365fd3b9 with Priority: HIGHEST for action port [ 692.460043] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 692.460386] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 692.460712] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177baf52-9490-4cc2-ac62-80b8365fd3b9 with Priority: HIGHEST for action port [ 692.461121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.463200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.463200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.463200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.463200] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.465932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.465932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.466436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-177baf52-9490-4cc2-ac62-80b8365fd3b9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.466436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.466436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.466903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.466903] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177baf52-9490-4cc2-ac62-80b8365fd3b9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.504274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 692.504564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.575691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc36c0b7-9863-4636-8c38-bba87eaf7e55 [ 692.575904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.576041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.576107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.576317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.577143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.577143] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc36c0b7-9863-4636-8c38-bba87eaf7e55 already deleted. [ 692.577143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc36c0b7-9863-4636-8c38-bba87eaf7e55" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.663314] env[65469]: INFO networking_nsxv3.common.synchronization [req-713e0c68-1a87-42ab-be4d-ee8c7aa804ec req-4cddc9b0-934a-4e28-9c8e-7033c818a03d tempest-FloatingIPsAssociationTestJSON-606961835 tempest-FloatingIPsAssociationTestJSON-606961835-project-member] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 692.664028] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 692.664448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.664556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.664556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.665259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.665259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.665259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.665995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.666241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.666337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.666440] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.839611] env[65469]: INFO networking_nsxv3.common.synchronization [req-d138f4ee-d3f0-4f0c-a072-dd6a62cadfa3 req-c2a7c5d1-214a-46d0-a00a-923fecbd30dd tempest-ImagesNegativeTestJSON-585475248 tempest-ImagesNegativeTestJSON-585475248-project-member] Enqueued Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 692.841316] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGHEST for action security_group_members [ 692.841316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.841316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.841316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.841316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.841592] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.841790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.841928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.842207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.842395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.842532] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.968716] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.968716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.970513] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 177baf52-9490-4cc2-ac62-80b8365fd3b9 with status ACTIVE [ 692.970830] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.971050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.971167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.971494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.972137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.972137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.972137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.972294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.972469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.972611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.973026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.973116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.974043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.974525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.974669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.974823] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 177baf52-9490-4cc2-ac62-80b8365fd3b9 is going to be updated. [ 693.002024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.002024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.002024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.002024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.002024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.002024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177baf52-9490-4cc2-ac62-80b8365fd3b9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.171953] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.238702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 693.238783] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 693.238898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.239141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.239388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.239612] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.239743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.239816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.240011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.240118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.240217] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.345310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.345520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.345571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.345772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.346284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.346284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.346284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.346284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.347302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.347302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.347302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 is going to be updated. [ 693.375582] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.375736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.375796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.375991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.376158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.386211] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: IN_PROGRESS for 2s [ 693.674357] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.731281] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: SUCCESS [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.731281] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.731281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.731697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.731697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.731697] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.742490] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.177966] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.177966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.177966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.178604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.178604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.178937] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be updated. [ 694.217660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.217907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.217907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.218149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.218299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.228539] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 694.234090] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.234240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.234301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.234551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.234678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.234784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.234836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.234985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.235076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.235181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.235302] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.235392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.235447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.235614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.235768] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.235855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.235897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.236045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.236122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.236200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.236291] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.244756] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.738811] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56fa7160-9619-4025-888c-7ea4b50f157c: rpc.has_security_group_logging(os_id): False [ 694.746474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.747403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.747403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.747403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.747403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.747403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 694.763649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.763996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.763996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.764181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.764296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.764538] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.764999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.764999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.764999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.765166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.765282] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.765723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.765723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.765723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.765809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.765996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.766582] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c is going to be created. [ 694.780310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.780487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.780558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.780765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.780941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.791210] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 694.880090] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.880428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.880556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.880797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.880992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.897174] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: IN_PROGRESS for 2s [ 695.398135] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 in Status: SUCCESS [ 695.398135] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 deletion is rescheduled due to dependency. [ 695.398135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.240268] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 696.240536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.801684] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 696.801999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.802154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.802387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.802583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.802701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.802804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.802959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.803152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.803229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.803322] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.909623] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: SUCCESS [ 696.909793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.306992] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.307396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.307396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.307559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.307776] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.307933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.307990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.308221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.308324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.308418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.308608] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.308708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.311024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.311024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.311024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.311024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.311024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.313234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.313375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.313497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.313605] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.691653] env[65469]: INFO networking_nsxv3.common.synchronization [req-b6b7dd8a-1bc1-4d1a-b6cc-3f55daaf0243 req-3ab8d90a-6807-46e9-ba33-f39d6525fe16 tempest-ServersTestManualDisk-885771844 tempest-ServersTestManualDisk-885771844-project-member] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 697.692413] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 697.692835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.692988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.693091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.693380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.693595] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.693716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.693786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.694014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.694122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.694220] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.820905] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 697.844028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.844028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.844028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.844028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.844561] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.844561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.844561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.844561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.844561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.845342] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 697.873836] env[65469]: INFO networking_nsxv3.common.synchronization [req-6448b209-12bf-4d78-8529-5079cb88b687 req-a8d9af0a-4d84-49b2-a3aa-022fcc4fbd43 tempest-ServersTestFqdnHostnames-603046965 tempest-ServersTestFqdnHostnames-603046965-project-member] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 697.874142] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGHEST for action security_group_members [ 697.874363] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.876354] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.876354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.876354] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.927338] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.927724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.927913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.928236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.928492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.941399] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 698.196716] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.197542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.197542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.197542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.197542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.197542] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.198445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.198635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.199160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.199255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.199663] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c already deleted. [ 698.199663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.329317] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-214 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.329317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-214" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.329317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-214" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.329317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-214" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.329554] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.329677] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.329792] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.330011] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.330193] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.330403] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.330495] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.330978] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.330978] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.330978] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.330978] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.331146] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.356069] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.356401] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.356401] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.356562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-214" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.356857] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-3effc61f-d273-4282-b67b-5e3975205918 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.357032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.357149] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.357542] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.357606] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3effc61f-d273-4282-b67b-5e3975205918',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.379071] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.379271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.379343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.379557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.379650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.379852] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.379951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.380038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.380497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.380583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.380673] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 is going to be updated. [ 698.410129] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.410129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.410129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.410129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.410413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.421284] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: IN_PROGRESS for 2s [ 698.860280] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.860640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.860640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.861016] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.861087] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.861204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 3effc61f-d273-4282-b67b-5e3975205918 not found, creating... [ 698.861453] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.861599] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.861709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.861919] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.862067] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.862390] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.862545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.862658] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.862855] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.862985] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.863131] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 3effc61f-d273-4282-b67b-5e3975205918 is going to be created. [ 698.883624] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.883873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.884038] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.884335] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.884633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.884841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.631344] env[65469]: INFO networking_nsxv3.common.synchronization [req-b6b7dd8a-1bc1-4d1a-b6cc-3f55daaf0243 req-5520e4ed-7e84-453a-bab2-308f47a48c4b service nova] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 699.631528] env[65469]: INFO networking_nsxv3.common.synchronization [req-b6b7dd8a-1bc1-4d1a-b6cc-3f55daaf0243 req-5520e4ed-7e84-453a-bab2-308f47a48c4b service nova] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 699.631699] env[65469]: INFO networking_nsxv3.common.synchronization [req-b6b7dd8a-1bc1-4d1a-b6cc-3f55daaf0243 req-5520e4ed-7e84-453a-bab2-308f47a48c4b service nova] Enqueued Resource ID: 3effc61f-d273-4282-b67b-5e3975205918 with Priority: HIGHEST for action port [ 699.633255] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_rules [ 699.633412] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 699.633515] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3effc61f-d273-4282-b67b-5e3975205918 with Priority: HIGHEST for action port [ 699.633806] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.633935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.634014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.634219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.634299] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.639525] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.639525] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.639525] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.639525] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3effc61f-d273-4282-b67b-5e3975205918 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.639525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.639525] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3effc61f-d273-4282-b67b-5e3975205918',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.955911] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 699.955911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.141469] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.143571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.143571] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3effc61f-d273-4282-b67b-5e3975205918 with status ACTIVE [ 700.143571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.143571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.143571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.143888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.143888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.143958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.144063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.144121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.144353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.144353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.144462] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.144546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.144591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.144779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.144779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.144961] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3effc61f-d273-4282-b67b-5e3975205918 is going to be updated. [ 700.146065] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.186073] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.186073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.188266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.188266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.188266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.188266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3effc61f-d273-4282-b67b-5e3975205918" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.442057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 in Status: SUCCESS [ 700.442373] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 deletion is rescheduled due to dependency. [ 700.442563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.648295] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.151603] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.151978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.151978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.152581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.153190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.153419] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c is going to be created. [ 701.189362] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.189502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.189502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.190411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.190411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.202288] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: UNINITIALIZED for 2s [ 702.889850] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d104dc5c-2bf4-4ca0-bfa1-926ace63cec1 None None] Enqueued Resource ID: 9573c6bf-9565-4798-b3f5-6807aaf21ee4 with Priority: HIGHEST for action port [ 702.891978] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9573c6bf-9565-4798-b3f5-6807aaf21ee4 with Priority: HIGHEST for action port [ 702.891978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9573c6bf-9565-4798-b3f5-6807aaf21ee4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.891978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9573c6bf-9565-4798-b3f5-6807aaf21ee4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.891978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9573c6bf-9565-4798-b3f5-6807aaf21ee4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.891978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9573c6bf-9565-4798-b3f5-6807aaf21ee4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.891978] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9573c6bf-9565-4798-b3f5-6807aaf21ee4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.215424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: SUCCESS [ 703.215424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.215424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.215424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.215636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.215636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.215636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.216032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.216032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.216032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.216146] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.395177] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9573c6bf-9565-4798-b3f5-6807aaf21ee4 [ 703.395592] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.395751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.395821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.396086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.396141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.396246] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9573c6bf-9565-4798-b3f5-6807aaf21ee4 already deleted. [ 703.396332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9573c6bf-9565-4798-b3f5-6807aaf21ee4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.719105] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.783998] env[65469]: INFO networking_nsxv3.common.synchronization [req-42fe59d7-4e45-4d32-a548-e1df59cd5226 req-865f51a9-6097-4a6e-b4be-6e6491e1c935 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 703.784595] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 703.784927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.786326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.786326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.786326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.786326] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.786326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.786326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.786517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.786586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.786695] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.221804] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71d94ce4-df7c-4b0a-9c44-8268f774539c: rpc.has_security_group_logging(os_id): False [ 704.249450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.249450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.249450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.249450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c is going to be created. [ 704.289020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.289233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.289305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.289558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.289676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.289919] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.290080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.290169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.290376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.290454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.290539] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 already deleted. [ 704.290617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.321023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.321023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.321023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.321023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.321023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.337869] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: IN_PROGRESS for 2s [ 704.363828] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-377 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.365308] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-377" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.365496] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-377" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.365968] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-377" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.366295] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.366513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.366657] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.366912] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.367509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.367509] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.367509] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.370045] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.370045] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.370045] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.370045] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.370045] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.429727] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.429976] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.061 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.430241] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.430550] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-377" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.434038] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-18f90b1a-d6d8-4afb-b641-f7d089899e3f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.434038] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.434038] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.434338] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.434536] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f90b1a-d6d8-4afb-b641-f7d089899e3f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.939932] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939932] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 18f90b1a-d6d8-4afb-b641-f7d089899e3f not found, creating... [ 704.939932] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.939932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.940512] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.940512] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.941416] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.941509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.941814] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.942050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f is going to be created. [ 704.966241] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.966241] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.966241] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.966741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.966741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.966924] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.638643] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c2753ce9-32c3-45ca-b424-a526a09601f4 None None] Enqueued Resource ID: 6fc9da8c-1396-4043-b1fe-6293bec227b4 with Priority: HIGHEST for action port [ 705.639143] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fc9da8c-1396-4043-b1fe-6293bec227b4 with Priority: HIGHEST for action port [ 705.639483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fc9da8c-1396-4043-b1fe-6293bec227b4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.639626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fc9da8c-1396-4043-b1fe-6293bec227b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.639688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fc9da8c-1396-4043-b1fe-6293bec227b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.639912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fc9da8c-1396-4043-b1fe-6293bec227b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.639995] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc9da8c-1396-4043-b1fe-6293bec227b4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.657560] env[65469]: INFO networking_nsxv3.common.synchronization [req-42fe59d7-4e45-4d32-a548-e1df59cd5226 req-735d0aa3-470d-457d-a367-162ac8518ba1 service nova] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 705.657731] env[65469]: INFO networking_nsxv3.common.synchronization [req-42fe59d7-4e45-4d32-a548-e1df59cd5226 req-735d0aa3-470d-457d-a367-162ac8518ba1 service nova] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 705.657856] env[65469]: INFO networking_nsxv3.common.synchronization [req-42fe59d7-4e45-4d32-a548-e1df59cd5226 req-735d0aa3-470d-457d-a367-162ac8518ba1 service nova] Enqueued Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 705.658407] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 705.658552] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 705.658651] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 705.658943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.659249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.659249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.659435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.659435] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.660337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.660558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.660558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.660763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.661235] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.661367] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.661432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.661588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.661679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.661767] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.662739] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-18f90b1a-d6d8-4afb-b641-f7d089899e3f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.662851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.662915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.666048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.666048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f90b1a-d6d8-4afb-b641-f7d089899e3f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.142779] env[65469]: INFO networking_nsxv3.common.synchronization [req-a2e7f8a5-df35-4d28-9afb-d7ac9ff6683c req-2cd8088e-1bdd-4913-a136-fe5b31d97701 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 706.143572] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fc9da8c-1396-4043-b1fe-6293bec227b4 [ 706.143572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.143572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.143797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.143826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.143919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.144021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fc9da8c-1396-4043-b1fe-6293bec227b4 already deleted. [ 706.144102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fc9da8c-1396-4043-b1fe-6293bec227b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.144727] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 706.145082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.145609] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.146062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.146381] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.168348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.168473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.168642] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.170719] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18f90b1a-d6d8-4afb-b641-f7d089899e3f with status ACTIVE [ 706.170916] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.171054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.171129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.171339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.171427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.171598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.171738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.171767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.171916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.171999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.172198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.172292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.172355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.172493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.172566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.172647] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f is going to be updated. [ 706.197252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.197408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.197481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.197685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.197819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.198021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.356029] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: SUCCESS [ 706.356029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.553838] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.556465] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.556465] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.556465] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.556782] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.556966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.557100] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.557333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.557472] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.557671] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.557804] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.557911] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.558067] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.558181] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.558305] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.558433] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.581312] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.582540] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.582540] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.582540] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.582540] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-384823ed-4253-4e4e-9f3e-a789d020f7b6 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.582540] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.582540] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.582819] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.582880] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384823ed-4253-4e4e-9f3e-a789d020f7b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.648992] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.649361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.649361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.649550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.649656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.649857] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.649952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.650029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.650179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.650274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.650651] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d already deleted. [ 706.650651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.675187] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.086681] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.086966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.087067] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.087322] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.087473] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.087640] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 384823ed-4253-4e4e-9f3e-a789d020f7b6 not found, creating... [ 707.087946] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.088140] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.088270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.088524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.088640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.088960] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.089147] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.089270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.089501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.089623] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.089769] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 384823ed-4253-4e4e-9f3e-a789d020f7b6 is going to be created. [ 707.111557] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.111557] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.111557] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.111557] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.111912] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.112045] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.177613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.177845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.178039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.178243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.178379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.178487] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be created. [ 707.226652] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.226652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.226652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.226652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.226652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.243114] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: UNINITIALIZED for 2s [ 707.649204] env[65469]: INFO networking_nsxv3.common.synchronization [None req-10fab447-c3e6-4bf8-988b-514b2b8f596c None None] Enqueued Resource ID: 62f5ff56-bf91-4055-bcc3-6cea0d375943 with Priority: HIGHEST for action port [ 707.649483] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f5ff56-bf91-4055-bcc3-6cea0d375943 with Priority: HIGHEST for action port [ 707.651988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-62f5ff56-bf91-4055-bcc3-6cea0d375943 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.652096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62f5ff56-bf91-4055-bcc3-6cea0d375943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.652177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62f5ff56-bf91-4055-bcc3-6cea0d375943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.652500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62f5ff56-bf91-4055-bcc3-6cea0d375943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.653526] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62f5ff56-bf91-4055-bcc3-6cea0d375943',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.844049] env[65469]: INFO networking_nsxv3.common.synchronization [req-a2e7f8a5-df35-4d28-9afb-d7ac9ff6683c req-8b463f6f-48b6-473e-8539-f8d83bdb5b20 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 707.844308] env[65469]: INFO networking_nsxv3.common.synchronization [req-a2e7f8a5-df35-4d28-9afb-d7ac9ff6683c req-8b463f6f-48b6-473e-8539-f8d83bdb5b20 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 707.844455] env[65469]: INFO networking_nsxv3.common.synchronization [req-a2e7f8a5-df35-4d28-9afb-d7ac9ff6683c req-8b463f6f-48b6-473e-8539-f8d83bdb5b20 service nova] Enqueued Resource ID: 384823ed-4253-4e4e-9f3e-a789d020f7b6 with Priority: HIGHEST for action port [ 707.844984] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 707.845137] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 707.845235] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384823ed-4253-4e4e-9f3e-a789d020f7b6 with Priority: HIGHEST for action port [ 707.845560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.845632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.845820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.846390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.846484] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.847353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.847475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.847531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.847704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.847886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.847993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.848099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.848248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.848338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.848467] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.849564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-384823ed-4253-4e4e-9f3e-a789d020f7b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.849716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.849789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.849992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.850120] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384823ed-4253-4e4e-9f3e-a789d020f7b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.157816] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62f5ff56-bf91-4055-bcc3-6cea0d375943 [ 708.158117] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.158257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.158330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.158547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.158641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.159234] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62f5ff56-bf91-4055-bcc3-6cea0d375943 already deleted. [ 708.159234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62f5ff56-bf91-4055-bcc3-6cea0d375943" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.351368] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.352545] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.352663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.352847] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 384823ed-4253-4e4e-9f3e-a789d020f7b6 with status ACTIVE [ 708.353015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.353133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.353205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.353413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.353491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.353655] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.353767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.353812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.353964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.354112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.354299] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.354404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.354462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.355176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.355235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.355302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 384823ed-4253-4e4e-9f3e-a789d020f7b6 is going to be updated. [ 708.380348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.380519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.380519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.380983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.380983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.380983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-384823ed-4253-4e4e-9f3e-a789d020f7b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.402615] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc9b181a-8b86-4b5d-8f97-7aa725aeec76 req-53137821-0df1-40c2-b6f1-b210e035a1a5 tempest-ServersNegativeTestJSON-2024414313 tempest-ServersNegativeTestJSON-2024414313-project-member] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 708.403517] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 708.404477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.404477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.404477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.404477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.404477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.404782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.404782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.405858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.405989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.406073] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.859519] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.909905] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.921305] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.921537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.922961] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.923317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923633] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.923812] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.923928] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.925631] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.925786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.926139] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.926262] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.926379] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.926469] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.926613] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.926727] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.926864] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.955451] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.955451] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.955451] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.955451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.955451] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-e03946d3-9fb7-488e-8a88-82aff366f9dd taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.955451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.955451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.955974] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.955974] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03946d3-9fb7-488e-8a88-82aff366f9dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.253067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 709.253327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.253540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.253801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.254021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.254173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.254243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.254478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.254577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.254681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.254801] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.362110] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.362314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.362314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.362533] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.362607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.362698] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be created. [ 709.393203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.393501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.393501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.393665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.393833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.405616] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: UNINITIALIZED for 2s [ 709.413702] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.415520] env[65469]: INFO networking_nsxv3.common.synchronization [None req-2786154f-81f0-43f6-8ca5-b89b541b9a26 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 709.418325] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 709.419232] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.419424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.419508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.419744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.419844] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.458714] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.462032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port e03946d3-9fb7-488e-8a88-82aff366f9dd not found, creating... [ 709.462032] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.462032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.462500] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.462500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.462500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.462815] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.463063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.463285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: e03946d3-9fb7-488e-8a88-82aff366f9dd is going to be created. [ 709.487029] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.487365] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.487516] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.487710] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.488159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.488497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.609038] env[65469]: INFO networking_nsxv3.common.synchronization [None req-93e153dc-4ef1-440a-b392-9bf7768f137d tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 709.609561] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 709.609937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.610129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.757565] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.922081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.922649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.922719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.922935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.923078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.923203] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 709.948335] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.948335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.948335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.948335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.948648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.948648] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c already deleted. [ 709.948648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.948833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.949520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.949520] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.979761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.979968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.979968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.980209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.985207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.005581] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 710.119798] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9a041bb9-23bc-44a4-b90e-3fd48445f7bd None None] Enqueued Resource ID: fb7c189d-3b66-4b68-87ef-62fbdc22cf93 with Priority: HIGHEST for action port [ 710.120516] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb7c189d-3b66-4b68-87ef-62fbdc22cf93 with Priority: HIGHEST for action port [ 710.120860] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb7c189d-3b66-4b68-87ef-62fbdc22cf93 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.121129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb7c189d-3b66-4b68-87ef-62fbdc22cf93" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.121216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb7c189d-3b66-4b68-87ef-62fbdc22cf93" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.121510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb7c189d-3b66-4b68-87ef-62fbdc22cf93" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.121602] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb7c189d-3b66-4b68-87ef-62fbdc22cf93',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.259910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65: rpc.has_security_group_logging(os_id): False [ 710.282619] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.282795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.282795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.282976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.283087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.283345] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.283448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.283511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.283797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.283797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.283903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be created. [ 710.367450] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc9b181a-8b86-4b5d-8f97-7aa725aeec76 req-ff1e7cb8-5292-4420-8b6e-17ddd31758c5 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 710.367653] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc9b181a-8b86-4b5d-8f97-7aa725aeec76 req-ff1e7cb8-5292-4420-8b6e-17ddd31758c5 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 710.367803] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc9b181a-8b86-4b5d-8f97-7aa725aeec76 req-ff1e7cb8-5292-4420-8b6e-17ddd31758c5 service nova] Enqueued Resource ID: e03946d3-9fb7-488e-8a88-82aff366f9dd with Priority: HIGHEST for action port [ 710.368460] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 710.368616] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 710.368711] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03946d3-9fb7-488e-8a88-82aff366f9dd with Priority: HIGHEST for action port [ 710.369547] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.369547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.369547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.369547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.369547] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.371359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.371359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.371359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e03946d3-9fb7-488e-8a88-82aff366f9dd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.371359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.371359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.371359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.371359] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03946d3-9fb7-488e-8a88-82aff366f9dd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.384606] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.384761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.384811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.385062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.385288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.401276] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: IN_PROGRESS for 2s [ 710.484998] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.484998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.484998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.484998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.484998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.484998] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c already deleted. [ 710.484998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.627411] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb7c189d-3b66-4b68-87ef-62fbdc22cf93 [ 710.627637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.627837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.627837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.628502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.628502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.628502] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb7c189d-3b66-4b68-87ef-62fbdc22cf93 already deleted. [ 710.628502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb7c189d-3b66-4b68-87ef-62fbdc22cf93" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.875716] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e03946d3-9fb7-488e-8a88-82aff366f9dd with status ACTIVE [ 710.875953] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.876151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.876151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.876366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.876466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.876633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.876733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.876791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.876975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.877096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.877357] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.877357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.877445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.877644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.877706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.877772] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e03946d3-9fb7-488e-8a88-82aff366f9dd is going to be updated. [ 710.879573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.879573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.902823] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.902823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.902823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.902990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.903093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.903297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e03946d3-9fb7-488e-8a88-82aff366f9dd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.268845] env[65469]: INFO networking_nsxv3.common.synchronization [req-15c0509f-f217-4f63-9436-657d19f86534 req-8e65504a-51f3-476a-a51d-333346bf666e tempest-AttachInterfacesV270Test-612510472 tempest-AttachInterfacesV270Test-612510472-project-member] Enqueued Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 711.269484] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 711.269792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.269962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.270087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.273340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.273516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.273629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.273690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.273851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.273935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.274073] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.418422] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 711.418757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.419028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.419315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.419577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.419736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.419836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.420071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.420199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.420320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.420451] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.732650] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.732884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-474" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.734695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-474" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.736238] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-474" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.736635] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.736890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.737055] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.737358] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.737549] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.737866] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.738056] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.738159] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.738279] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.738412] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.738507] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.738665] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.767058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.767305] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.767473] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.767771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-474" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.768400] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-25cd28d8-400c-401c-bea9-60e07f572beb taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.768655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.768805] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.769475] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.769475] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cd28d8-400c-401c-bea9-60e07f572beb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.778388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.778388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.778388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.778388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.779679] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.779679] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 already deleted. [ 711.779679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.923672] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.923822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.923890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.924150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.924636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.924636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.924636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.924636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.924827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.924827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.925144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.925144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.925144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.925282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.925412] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.925620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.925620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.925702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.926067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.926067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.926067] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.016787] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 712.017099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.017340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.017689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.017903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.018110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.018226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.018385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.018505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.018621] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.272864] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.273286] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.273286] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.273554] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.273724] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.273879] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 25cd28d8-400c-401c-bea9-60e07f572beb not found, creating... [ 712.274173] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.274326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.274438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.274668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.274794] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.275221] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.275461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.275507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.275803] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.275967] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.276127] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 25cd28d8-400c-401c-bea9-60e07f572beb is going to be created. [ 712.302195] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.302548] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.302730] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.303112] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.303441] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.303759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.416442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 712.416760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.430214] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 712.462077] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.462254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.462334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.462568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.462668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.462887] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.463020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.463085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.463929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.463929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463929] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.463929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.463929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.463929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.464190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.464244] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.464358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.464419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.464585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.464656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.464759] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be created. [ 712.520894] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.541104] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.541247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.542040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.542040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.542040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.556722] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 713.026555] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.110134] env[65469]: INFO networking_nsxv3.common.synchronization [req-15c0509f-f217-4f63-9436-657d19f86534 req-2a76c4b0-7881-48d0-a244-5191b75c1965 service nova] Enqueued Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_rules [ 713.110268] env[65469]: INFO networking_nsxv3.common.synchronization [req-15c0509f-f217-4f63-9436-657d19f86534 req-2a76c4b0-7881-48d0-a244-5191b75c1965 service nova] Enqueued Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 713.110393] env[65469]: INFO networking_nsxv3.common.synchronization [req-15c0509f-f217-4f63-9436-657d19f86534 req-2a76c4b0-7881-48d0-a244-5191b75c1965 service nova] Enqueued Resource ID: 25cd28d8-400c-401c-bea9-60e07f572beb with Priority: HIGHEST for action port [ 713.110891] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_rules [ 713.111044] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 713.111148] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25cd28d8-400c-401c-bea9-60e07f572beb with Priority: HIGHEST for action port [ 713.111843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.111912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.111959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.112240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.112328] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.113288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.113288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.113381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.113523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.113675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.113786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.113898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.114188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.114188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.114188] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.115094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-25cd28d8-400c-401c-bea9-60e07f572beb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.115094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.115270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.115311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.115361] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cd28d8-400c-401c-bea9-60e07f572beb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.529650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.529967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.530029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.530295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.530403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.530502] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 713.562271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.562432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.563040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.563040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.563040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.572783] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 713.617470] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.617645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.617893] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.618962] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25cd28d8-400c-401c-bea9-60e07f572beb with status ACTIVE [ 713.619133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.619241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.619308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.619512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.619600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.619766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.619861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.619927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.620094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.620194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.620397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.620504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.620568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.620706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.620779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.620861] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25cd28d8-400c-401c-bea9-60e07f572beb is going to be updated. [ 713.657328] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.657418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.657708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.657708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.657773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.657935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25cd28d8-400c-401c-bea9-60e07f572beb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.122888] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.570960] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 714.571320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.626938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.627261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.627358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.627638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.627777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.627893] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 is going to be created. [ 714.656494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.656494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.656494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.671019] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: UNINITIALIZED for 2s [ 714.965794] env[65469]: INFO networking_nsxv3.common.synchronization [req-79d25722-d1f3-4d1b-8cd6-300498e6cc6f req-26bd7fca-5d87-4ccd-8719-ea076af6b6cb tempest-InstanceActionsTestJSON-381140382 tempest-InstanceActionsTestJSON-381140382-project-member] Enqueued Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 714.966507] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGHEST for action security_group_members [ 714.968307] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.968307] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.968307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.968307] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.471506] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.471633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.471673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.471929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.472084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.472307] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.472409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.472494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.472634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.472711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.472801] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 is going to be updated. [ 715.501394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.501574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.501646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.501857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.502009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.516508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: IN_PROGRESS for 2s [ 715.586069] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.586069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.586069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.586069] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.090874] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.090874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.090874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.090874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.091870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.091870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.091870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.091870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.092902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.092902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.092902] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.092902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.092902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.093591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.094813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.094813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.094813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.094956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.094999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.095625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.095625] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.598856] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1222eeb9-9dbe-496c-9f03-31010145cde2: rpc.has_security_group_logging(os_id): False [ 716.619646] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.619646] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.619646] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.620283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.620283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.620283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.620283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.620283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.620283] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 716.682917] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: SUCCESS [ 716.683181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.683441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.683724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.683783] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.683883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.683950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.685414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.685414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.685414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.685414] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.687151] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.687273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.687349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.688087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.688087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.703515] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 717.190249] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.190496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.190569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.190859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.195027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.195027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.195027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.195027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.195027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.527475] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 in Status: SUCCESS [ 717.527704] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 deletion is rescheduled due to dependency. [ 717.527794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.695488] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33207950-68c2-4f12-b68f-e8f5a186fd46: rpc.has_security_group_logging(os_id): False [ 717.718993] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.719202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.719325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.719630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.719773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.720117] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.720455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.720671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.720973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.721131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.721471] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.721720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.721822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.722100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.722288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.722539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.722687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.722776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.722951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.723087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.723216] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 is going to be created. [ 717.800289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.800487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.800567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.800789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.801009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.817600] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: IN_PROGRESS for 2s [ 718.721631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 718.722610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.049753] env[65469]: INFO networking_nsxv3.common.synchronization [req-f702b288-ca72-4db0-9f7b-c2d71b933fc0 req-03c30f74-0efa-4f23-87d0-26c6bdce3050 tempest-FloatingIPsAssociationTestJSON-606961835 tempest-FloatingIPsAssociationTestJSON-606961835-project-member] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 719.050284] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGHEST for action security_group_members [ 719.050653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.050781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.050863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.051218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.051437] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.051595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.051709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.051937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.052339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.052510] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.555983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.556276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.556354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.556628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.556756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.556955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.557109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.557160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.557301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.557375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.557470] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be updated. [ 719.595581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.595815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.595897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.596584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.596584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.610881] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: IN_PROGRESS for 2s [ 719.726218] env[65469]: INFO networking_nsxv3.common.synchronization [None req-61273010-198a-4af8-aa52-599ecf4618ac tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: bab1d867-3531-4634-87c2-526f9afa7638 with Priority: HIGHEST for action security_group_rules [ 719.727215] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab1d867-3531-4634-87c2-526f9afa7638 with Priority: HIGHEST for action security_group_rules [ 719.727215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab1d867-3531-4634-87c2-526f9afa7638 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.727215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.729127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.729127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.729127] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab1d867-3531-4634-87c2-526f9afa7638',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.839722] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: SUCCESS [ 719.840124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.271554] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.271554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.271554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.271554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.271554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.271554] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab1d867-3531-4634-87c2-526f9afa7638 already deleted. [ 720.271554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.445119] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e9c05141-be38-4690-875a-2a3ddc8a8d12 tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: bab1d867-3531-4634-87c2-526f9afa7638 with Priority: HIGHEST for action security_group_rules [ 720.445791] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab1d867-3531-4634-87c2-526f9afa7638 with Priority: HIGHEST for action security_group_rules [ 720.445985] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab1d867-3531-4634-87c2-526f9afa7638 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.446140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.446221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.446502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.446905] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab1d867-3531-4634-87c2-526f9afa7638',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.658626] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d0f4d79b-02fe-4815-b2a7-db1a8dda563b None None] Enqueued Resource ID: c07187bd-52a4-4f5c-80f5-e5ff553546fd with Priority: HIGHEST for action port [ 720.659491] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07187bd-52a4-4f5c-80f5-e5ff553546fd with Priority: HIGHEST for action port [ 720.659491] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c07187bd-52a4-4f5c-80f5-e5ff553546fd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.659628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c07187bd-52a4-4f5c-80f5-e5ff553546fd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.659687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c07187bd-52a4-4f5c-80f5-e5ff553546fd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.660479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c07187bd-52a4-4f5c-80f5-e5ff553546fd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.660479] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c07187bd-52a4-4f5c-80f5-e5ff553546fd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.858976] env[65469]: INFO networking_nsxv3.common.synchronization [req-9c5ed03c-f584-457e-a7df-fbe70bce0958 req-e49f2d92-bf88-46c3-9014-bf2e3bb920a3 tempest-ListImageFiltersTestJSON-1904470615 tempest-ListImageFiltersTestJSON-1904470615-project-member] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 720.858976] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 720.858976] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.863209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.863209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.863209] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.972736] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.972736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.972736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.972736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.972736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.972736] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab1d867-3531-4634-87c2-526f9afa7638 already deleted. [ 720.972736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab1d867-3531-4634-87c2-526f9afa7638" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.164026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c07187bd-52a4-4f5c-80f5-e5ff553546fd [ 721.164026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.164026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.164026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.164026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.164026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.164026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c07187bd-52a4-4f5c-80f5-e5ff553546fd already deleted. [ 721.164026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c07187bd-52a4-4f5c-80f5-e5ff553546fd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.365855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.365855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.366461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.366461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.366526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.366710] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.366826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.366891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.367063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.367147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.367237] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 already deleted. [ 721.367318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.386686] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.386902] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.387060] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.388306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.388730] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.389820] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.390046] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.393326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.393489] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393702] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.393808] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.393916] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.394028] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.394130] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.394290] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.397963] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.418044] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.418044] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.418044] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.418044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.418044] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-b172b6b2-8807-4e93-9a5a-50ff65af9221 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.418044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.418417] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.419364] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.419364] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b172b6b2-8807-4e93-9a5a-50ff65af9221',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.621629] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b09b8988-0604-4099-985a-5dc6c13cf18b in Status: SUCCESS [ 721.621629] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b deletion is rescheduled due to dependency. [ 721.621629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.922824] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.923133] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.923303] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.923669] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.923997] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.924343] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port b172b6b2-8807-4e93-9a5a-50ff65af9221 not found, creating... [ 721.924711] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.924886] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.925009] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.925271] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.925412] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.926557] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.927256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.928522] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.928522] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.928522] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.933166] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: b172b6b2-8807-4e93-9a5a-50ff65af9221 is going to be created. [ 721.959445] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.959728] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.959804] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.960063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.960293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.960513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.789448] env[65469]: INFO networking_nsxv3.common.synchronization [req-9c5ed03c-f584-457e-a7df-fbe70bce0958 req-c899a1c3-315b-4b81-a5ba-573f941508ba service nova] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_rules [ 722.789448] env[65469]: INFO networking_nsxv3.common.synchronization [req-9c5ed03c-f584-457e-a7df-fbe70bce0958 req-c899a1c3-315b-4b81-a5ba-573f941508ba service nova] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 722.789448] env[65469]: INFO networking_nsxv3.common.synchronization [req-9c5ed03c-f584-457e-a7df-fbe70bce0958 req-c899a1c3-315b-4b81-a5ba-573f941508ba service nova] Enqueued Resource ID: b172b6b2-8807-4e93-9a5a-50ff65af9221 with Priority: HIGHEST for action port [ 722.789551] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_rules [ 722.789641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 722.789736] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b172b6b2-8807-4e93-9a5a-50ff65af9221 with Priority: HIGHEST for action port [ 722.794117] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.794317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.794607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.794845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.794845] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.796154] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.796230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.796294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.796482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.799824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.799824] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.799824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b172b6b2-8807-4e93-9a5a-50ff65af9221 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.799824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.799824] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b172b6b2-8807-4e93-9a5a-50ff65af9221',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.300660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.300973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.302537] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.307197] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b172b6b2-8807-4e93-9a5a-50ff65af9221 with status ACTIVE [ 723.307197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.307197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.307197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.307197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.308136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.308488] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b172b6b2-8807-4e93-9a5a-50ff65af9221 is going to be updated. [ 723.335064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.335304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.335304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.335475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.335704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.336772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b172b6b2-8807-4e93-9a5a-50ff65af9221" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.542190] env[65469]: INFO networking_nsxv3.common.synchronization [req-568cba35-aa30-4469-af1f-287932df7c57 req-fa9a828c-ac4c-444c-ace5-e9b4de9bcd43 tempest-ListImageFiltersTestJSON-1904470615 tempest-ListImageFiltersTestJSON-1904470615-project-member] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 723.542190] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 723.542518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.542725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.660271] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7c6e9820-921d-4c64-a285-8f5a72d091c6 None None] Enqueued Resource ID: dce49bd6-2243-4524-b28d-364dc575816c with Priority: HIGHEST for action port [ 723.660852] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce49bd6-2243-4524-b28d-364dc575816c with Priority: HIGHEST for action port [ 723.662587] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-dce49bd6-2243-4524-b28d-364dc575816c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.662705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dce49bd6-2243-4524-b28d-364dc575816c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.662741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dce49bd6-2243-4524-b28d-364dc575816c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.662992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dce49bd6-2243-4524-b28d-364dc575816c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.663154] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce49bd6-2243-4524-b28d-364dc575816c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.812028] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.815389] env[65469]: INFO networking_nsxv3.common.synchronization [None req-effebf08-6b3c-4460-8085-740c273686a5 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 723.815823] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 723.816395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.818288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.818288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.819588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.819588] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.168528] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dce49bd6-2243-4524-b28d-364dc575816c [ 724.169698] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.169920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.169983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.170208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.170309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.170541] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dce49bd6-2243-4524-b28d-364dc575816c already deleted. [ 724.170541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dce49bd6-2243-4524-b28d-364dc575816c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.233547] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.233895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.234129] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.234534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.234975] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.235316] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.235525] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.235845] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.236146] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.236468] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.237044] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.237044] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.237910] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.237910] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.237910] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.237910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.261766] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.262863] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.262863] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.262863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.262863] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-96028484-9df7-431d-a938-c9d7012c83c3 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.262863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.263979] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.263979] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.263979] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96028484-9df7-431d-a938-c9d7012c83c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.316330] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.316330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.316330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.316701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.316701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.316701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be created. [ 724.339963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.340161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.340219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.340442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.340537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.340627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b already deleted. [ 724.340711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.345279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.345431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.345524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.345774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.345940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.357061] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: UNINITIALIZED for 2s [ 724.573491] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9caa0b1b-8e31-4285-82e8-778c0412148f tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 724.574182] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 724.574602] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.574823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.574930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.575454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.575454] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.766717] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.767196] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.767196] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.767408] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.767501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.767631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 96028484-9df7-431d-a938-c9d7012c83c3 not found, creating... [ 724.767883] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.768065] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.768221] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.768451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.768587] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.768872] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.769143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.769143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.769332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.769453] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.769585] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 96028484-9df7-431d-a938-c9d7012c83c3 is going to be created. [ 724.792462] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.792726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.792855] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.793138] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.793793] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.793793] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.099807] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.099807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.099807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.100148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.100148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.100148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b already deleted. [ 725.100148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.519439] env[65469]: INFO networking_nsxv3.common.synchronization [req-568cba35-aa30-4469-af1f-287932df7c57 req-b7454e48-bc25-4073-a54d-28015838d405 service nova] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_rules [ 725.521993] env[65469]: INFO networking_nsxv3.common.synchronization [req-568cba35-aa30-4469-af1f-287932df7c57 req-b7454e48-bc25-4073-a54d-28015838d405 service nova] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 725.526025] env[65469]: INFO networking_nsxv3.common.synchronization [req-568cba35-aa30-4469-af1f-287932df7c57 req-b7454e48-bc25-4073-a54d-28015838d405 service nova] Enqueued Resource ID: 96028484-9df7-431d-a938-c9d7012c83c3 with Priority: HIGHEST for action port [ 725.526025] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_rules [ 725.526025] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 725.526025] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96028484-9df7-431d-a938-c9d7012c83c3 with Priority: HIGHEST for action port [ 725.526025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.526025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.526025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-96028484-9df7-431d-a938-c9d7012c83c3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.526025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.526025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.526025] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96028484-9df7-431d-a938-c9d7012c83c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.716345] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8f437985-2e3f-4074-b4f7-fd45074fb767 None None] Enqueued Resource ID: df4c2740-5250-4e8e-bada-65dc3d4006aa with Priority: HIGHEST for action port [ 725.716673] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df4c2740-5250-4e8e-bada-65dc3d4006aa with Priority: HIGHEST for action port [ 725.718712] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-df4c2740-5250-4e8e-bada-65dc3d4006aa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.718712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df4c2740-5250-4e8e-bada-65dc3d4006aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.718712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df4c2740-5250-4e8e-bada-65dc3d4006aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.718998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df4c2740-5250-4e8e-bada-65dc3d4006aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.718998] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df4c2740-5250-4e8e-bada-65dc3d4006aa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.028870] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96028484-9df7-431d-a938-c9d7012c83c3 with status ACTIVE [ 726.029310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.032023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.032023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.032023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.032023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96028484-9df7-431d-a938-c9d7012c83c3 is going to be updated. [ 726.059157] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.059427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.059427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.059650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.059775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.059952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96028484-9df7-431d-a938-c9d7012c83c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.221735] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df4c2740-5250-4e8e-bada-65dc3d4006aa [ 726.222251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.222251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.222251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.222432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.222529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.222614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df4c2740-5250-4e8e-bada-65dc3d4006aa already deleted. [ 726.222688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df4c2740-5250-4e8e-bada-65dc3d4006aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.375024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.375024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.375024] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.375024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.375693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.375940] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.376236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.376387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.376682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.376829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.377050] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.880653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.880653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.880653] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.178795] env[65469]: INFO networking_nsxv3.common.synchronization [req-b3dc85db-341b-4d52-b4c2-de0b6b782d90 req-2e8c0594-cde9-4bfb-828b-07c6ef53b040 tempest-ServersNegativeTestJSON-2024414313 tempest-ServersNegativeTestJSON-2024414313-project-member] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 727.179388] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 727.179728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.179843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.179913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.180288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.180475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.180575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.180642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.180807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.180895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.180988] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.382204] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.683367] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.885475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.886219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.886219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.887302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.887302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.887302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 727.920387] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.920571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.920610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.920831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.920961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.934627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 728.147898] env[65469]: INFO networking_nsxv3.common.synchronization [None req-762a59ab-12c3-47eb-a65a-c59c6d873217 None None] Enqueued Resource ID: dcc9d20e-d938-4070-8672-d29afffecb57 with Priority: HIGHEST for action port [ 728.148210] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcc9d20e-d938-4070-8672-d29afffecb57 with Priority: HIGHEST for action port [ 728.149560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcc9d20e-d938-4070-8672-d29afffecb57 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.150789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcc9d20e-d938-4070-8672-d29afffecb57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.150789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcc9d20e-d938-4070-8672-d29afffecb57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.151807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcc9d20e-d938-4070-8672-d29afffecb57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.151807] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc9d20e-d938-4070-8672-d29afffecb57',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.187144] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.590080] env[65469]: INFO networking_nsxv3.common.synchronization [req-728485f9-80cf-494b-becb-0bbcc618ad83 req-3ada21fd-5e9f-4b87-b79b-ff3c51f74d58 tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 728.590635] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 728.591433] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.591433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.591433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.591679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.591971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.591971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.592100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.592392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.592392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.592392] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.655540] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcc9d20e-d938-4070-8672-d29afffecb57 [ 728.655850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.656034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.656127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.656409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.656521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.656642] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcc9d20e-d938-4070-8672-d29afffecb57 already deleted. [ 728.656747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcc9d20e-d938-4070-8672-d29afffecb57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.681145] env[65469]: INFO networking_nsxv3.common.synchronization [None req-78457ead-36c4-4c29-b834-576ecc2f2e75 None None] Enqueued Resource ID: 99bea16d-d0b9-4865-8e64-f6e2066d1feb with Priority: HIGHEST for action port [ 728.681638] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99bea16d-d0b9-4865-8e64-f6e2066d1feb with Priority: HIGHEST for action port [ 728.681919] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-99bea16d-d0b9-4865-8e64-f6e2066d1feb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.682055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99bea16d-d0b9-4865-8e64-f6e2066d1feb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.682117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99bea16d-d0b9-4865-8e64-f6e2066d1feb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.682365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99bea16d-d0b9-4865-8e64-f6e2066d1feb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.682439] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99bea16d-d0b9-4865-8e64-f6e2066d1feb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.692728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.692867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.692934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.693166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.693258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.693358] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 728.730034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.730034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.730034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.730355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.730355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.742405] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 729.094348] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.094662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.094662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.094962] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.095314] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.095532] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.095602] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.098037] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.098037] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.098037] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.098037] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.098037] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.098037] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.098037] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.098037] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.098037] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.098394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.098505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.098588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.098768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.098852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.099065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.099185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.099228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.099384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.099478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.099602] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 729.120412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.120601] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.120737] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.120931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.121331] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-f2f758c3-454d-4656-9f28-fa060f17cf4e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.121576] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.121640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.123392] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.123392] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f758c3-454d-4656-9f28-fa060f17cf4e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.130204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.130204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.130204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.130204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.130204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.144080] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 729.185152] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99bea16d-d0b9-4865-8e64-f6e2066d1feb [ 729.185818] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.185818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.185818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.186101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.186698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.186698] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99bea16d-d0b9-4865-8e64-f6e2066d1feb already deleted. [ 729.186698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99bea16d-d0b9-4865-8e64-f6e2066d1feb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.317212] env[65469]: INFO networking_nsxv3.common.synchronization [req-0fc6447f-2b8f-4659-8d86-6353ad832d25 req-c052f114-a21a-4928-b5a0-f1c7b7845103 tempest-ImagesOneServerTestJSON-1305422278 tempest-ImagesOneServerTestJSON-1305422278-project-member] Enqueued Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 729.317212] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGHEST for action security_group_members [ 729.318489] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.319167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.319493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.320190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.320477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.320702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.320874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.321184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.322563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.322563] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.625370] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.625370] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.625931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.626566] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.626673] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.626865] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port f2f758c3-454d-4656-9f28-fa060f17cf4e not found, creating... [ 729.628041] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.628041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.628041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.628041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.628354] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.628983] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.629194] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.629350] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.629601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.629798] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.630074] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: f2f758c3-454d-4656-9f28-fa060f17cf4e is going to be created. [ 729.654362] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.654362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.654362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.654362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.654633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.654663] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.824306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.824481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.824558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.824788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.824926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.825173] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.825314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.825388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.825582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.825656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.825752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d is going to be updated. [ 729.863714] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.863714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.863714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.863714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.863714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.872142] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: IN_PROGRESS for 2s [ 729.953425] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.953425] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.953425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.953425] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.429648] env[65469]: INFO networking_nsxv3.common.synchronization [req-728485f9-80cf-494b-becb-0bbcc618ad83 req-1cc51c3e-6021-4899-b543-af89c69db413 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 730.429928] env[65469]: INFO networking_nsxv3.common.synchronization [req-728485f9-80cf-494b-becb-0bbcc618ad83 req-1cc51c3e-6021-4899-b543-af89c69db413 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 730.429960] env[65469]: INFO networking_nsxv3.common.synchronization [req-728485f9-80cf-494b-becb-0bbcc618ad83 req-1cc51c3e-6021-4899-b543-af89c69db413 service nova] Enqueued Resource ID: f2f758c3-454d-4656-9f28-fa060f17cf4e with Priority: HIGHEST for action port [ 730.430550] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 730.430718] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 730.430860] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f758c3-454d-4656-9f28-fa060f17cf4e with Priority: HIGHEST for action port [ 730.431256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.431388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.431827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.431827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.431827] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.433304] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.433434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.433771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f758c3-454d-4656-9f28-fa060f17cf4e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.433867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.433905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.434077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.434166] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f758c3-454d-4656-9f28-fa060f17cf4e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.456110] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.760048] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 730.760277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.820216] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d2ab9b0c-a4d5-4a5b-aa3e-db18b10dde43 None None] Enqueued Resource ID: 4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5 with Priority: HIGHEST for action port [ 730.820719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5 with Priority: HIGHEST for action port [ 730.822150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.822542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.822542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.822755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.822961] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.934430] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.934577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.936993] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2f758c3-454d-4656-9f28-fa060f17cf4e with status ACTIVE [ 730.937255] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.937662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.937757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.937949] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.938061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.938126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.938359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.938440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.938624] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.938717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.938777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.938954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.939045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.939148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2f758c3-454d-4656-9f28-fa060f17cf4e is going to be updated. [ 730.958264] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.963913] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.964080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.964124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.964331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.964466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.964617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f758c3-454d-4656-9f28-fa060f17cf4e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.169483] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 731.169659] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 731.169832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.170139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.170624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.170745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.170929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.176129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.176867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.177027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.177203] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.327793] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5 [ 731.328924] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.328924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.329557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.329792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.329881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.330021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5 already deleted. [ 731.330081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d6b8d5a-3636-4ca9-bfa1-1f0a55f927b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.460594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.460899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.460899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.461238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.461356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.461395] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 731.494270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.494414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.494551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.494688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.494841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.506087] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 731.680608] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.885945] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d in Status: SUCCESS [ 731.886206] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d deletion is rescheduled due to dependency. [ 731.886286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.955223] env[65469]: INFO networking_nsxv3.common.synchronization [None req-5bd21248-2857-4f33-8cf2-21d7914ea3aa None None] Enqueued Resource ID: 430065f6-1ac9-498c-a43b-f0844221802a with Priority: HIGHEST for action port [ 731.955775] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 430065f6-1ac9-498c-a43b-f0844221802a with Priority: HIGHEST for action port [ 731.956119] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-430065f6-1ac9-498c-a43b-f0844221802a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.956288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-430065f6-1ac9-498c-a43b-f0844221802a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.956364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-430065f6-1ac9-498c-a43b-f0844221802a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.956631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-430065f6-1ac9-498c-a43b-f0844221802a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.956716] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('430065f6-1ac9-498c-a43b-f0844221802a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.020233] env[65469]: INFO networking_nsxv3.common.synchronization [req-489ecc55-8660-4266-b1a0-065b2a870589 req-bdbe6834-030f-446c-af05-1e97908fa5c7 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 732.020881] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 732.021714] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.021882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.021942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.022136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.022526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.022892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.022982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.023884] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.182894] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.460123] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 430065f6-1ac9-498c-a43b-f0844221802a [ 732.462028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.462028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.462028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.462028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.462028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.462028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:430065f6-1ac9-498c-a43b-f0844221802a already deleted. [ 732.462028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-430065f6-1ac9-498c-a43b-f0844221802a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.527184] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.586284] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.586493] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.587123] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.587123] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.587224] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.587442] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.587500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.587692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.587839] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.588172] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.588172] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.588317] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.588684] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.588839] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.588948] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.589106] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.610359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.610673] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.610856] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.611046] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.612040] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-5925a5a8-8e10-4f9a-8f44-15de96032a57 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.612040] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.612040] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.612292] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.612507] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5925a5a8-8e10-4f9a-8f44-15de96032a57',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.685166] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.685426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.685480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.685704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.685834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.685960] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 732.718478] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.718626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.718761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.718896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.720628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.731697] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 733.030093] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.115911] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.116247] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.116459] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.116759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.116876] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.116954] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 5925a5a8-8e10-4f9a-8f44-15de96032a57 not found, creating... [ 733.117339] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.117537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.117673] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.117952] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.118142] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.118924] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.118924] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.118924] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.119101] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.119101] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.119251] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 5925a5a8-8e10-4f9a-8f44-15de96032a57 is going to be created. [ 733.143434] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.143771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.143771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.144170] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.144406] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.144613] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.521106] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.521106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.521106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.522665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.523241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.523241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.523241] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.533072] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.533219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.533291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.533758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.534583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.534583] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 733.565029] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.565173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.565173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.565419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.565537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.575449] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 733.904968] env[65469]: INFO networking_nsxv3.common.synchronization [req-489ecc55-8660-4266-b1a0-065b2a870589 req-7c968e47-a56e-4019-bd0a-0e59d28ff84e service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 733.904968] env[65469]: INFO networking_nsxv3.common.synchronization [req-489ecc55-8660-4266-b1a0-065b2a870589 req-7c968e47-a56e-4019-bd0a-0e59d28ff84e service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 733.905293] env[65469]: INFO networking_nsxv3.common.synchronization [req-489ecc55-8660-4266-b1a0-065b2a870589 req-7c968e47-a56e-4019-bd0a-0e59d28ff84e service nova] Enqueued Resource ID: 5925a5a8-8e10-4f9a-8f44-15de96032a57 with Priority: HIGHEST for action port [ 733.905782] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 733.905782] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 733.905861] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925a5a8-8e10-4f9a-8f44-15de96032a57 with Priority: HIGHEST for action port [ 733.906502] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.906502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.906502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.906968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.906968] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.907752] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.907815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910095] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5925a5a8-8e10-4f9a-8f44-15de96032a57 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.910459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.911572] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5925a5a8-8e10-4f9a-8f44-15de96032a57',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.025948] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee1b710f-8b96-44eb-b935-7e6dcdbe6f18: rpc.has_security_group_logging(os_id): False [ 734.047619] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.047619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.047619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.047619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.047619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.047824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.047916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.047916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.048089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.048164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.048382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.048476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.048535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.048670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.048739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.049106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.049242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.049242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.049820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.049820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.049820] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be created. [ 734.124960] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.127021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.127021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.127021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.127021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.144245] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 734.293905] env[65469]: INFO networking_nsxv3.common.synchronization [req-d283119a-e519-4848-aaf5-7bf9eae02fe1 req-a1507175-a604-448c-a537-edcea658cb43 tempest-ServerMetadataNegativeTestJSON-1900175863 tempest-ServerMetadataNegativeTestJSON-1900175863-project-member] Enqueued Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 734.295482] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 734.296542] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.296542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.296542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.297716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.297981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.298098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.298169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.298468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.298598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.298731] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.413353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.413785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.413785] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5925a5a8-8e10-4f9a-8f44-15de96032a57 with status ACTIVE [ 734.413892] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.413951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.413996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.414251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.414353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.414480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.414557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.414619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.414775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.414852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.415135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.415135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.415267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.415339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.415386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.415472] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5925a5a8-8e10-4f9a-8f44-15de96032a57 is going to be updated. [ 734.440531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.440531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.440531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.440531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.440531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.440772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5925a5a8-8e10-4f9a-8f44-15de96032a57" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.468773] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6595dfbd-dd3b-4031-b037-0a8282e09fcb None None] Enqueued Resource ID: 142dce43-8c24-45b8-bfdc-ee6050e82e08 with Priority: HIGHEST for action port [ 734.469416] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142dce43-8c24-45b8-bfdc-ee6050e82e08 with Priority: HIGHEST for action port [ 734.469733] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-142dce43-8c24-45b8-bfdc-ee6050e82e08 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.469848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-142dce43-8c24-45b8-bfdc-ee6050e82e08" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.469921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-142dce43-8c24-45b8-bfdc-ee6050e82e08" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.470380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-142dce43-8c24-45b8-bfdc-ee6050e82e08" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.470485] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142dce43-8c24-45b8-bfdc-ee6050e82e08',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.683627] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.683627] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-286" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.684020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-286" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.684152] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-286" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.684411] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.684553] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.684665] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.684874] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.685032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.685252] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.685358] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.685459] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.685558] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.685657] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.685750] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.685871] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.714609] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.715187] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 734.715187] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.715328] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-286" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.715562] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-c39af72b-1658-45f4-92cd-1aa943f1e679 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.715831] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.715891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.717575] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.717575] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c39af72b-1658-45f4-92cd-1aa943f1e679',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.742659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 734.743293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.743293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.743434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.743786] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.743846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.743932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.744134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.744224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.744318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.744416] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.806629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.806629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.807075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.807553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.807626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.807812] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.807968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.808055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.808327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.808508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.808508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31117731-2c40-474a-b432-88e9d4361256 already deleted. [ 734.808630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.972393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 142dce43-8c24-45b8-bfdc-ee6050e82e08 [ 734.972635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.972950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.972950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.973106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.973143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.973245] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:142dce43-8c24-45b8-bfdc-ee6050e82e08 already deleted. [ 734.973326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-142dce43-8c24-45b8-bfdc-ee6050e82e08" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.219525] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.219757] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.222089] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port c39af72b-1658-45f4-92cd-1aa943f1e679 not found, creating... [ 735.222089] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.222089] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222618] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.223065] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: c39af72b-1658-45f4-92cd-1aa943f1e679 is going to be created. [ 735.246969] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.247407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.247407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.247699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.247699] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.247919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.247919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.248274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.248274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.248274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.248418] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.248418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.248531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.248596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.248709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.248856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.248856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.248988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.249065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.249259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.249394] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.254397] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.254397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.254397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.254663] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.254850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.255090] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.586614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 735.586856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.587209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.587407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.587534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.587674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.587739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.587894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.587983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.588106] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.755457] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 735.775273] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.775273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.775273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.775538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.775538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.776268] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.776268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.776268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.776268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.776268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.780332] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.780332] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.780332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.780332] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 735.849133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.849457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.849592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.849916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.850180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.867686] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 736.005331] env[65469]: INFO networking_nsxv3.common.synchronization [req-d283119a-e519-4848-aaf5-7bf9eae02fe1 req-5c04d669-0112-427a-ac1f-e6f950f59e72 service nova] Enqueued Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_rules [ 736.005703] env[65469]: INFO networking_nsxv3.common.synchronization [req-d283119a-e519-4848-aaf5-7bf9eae02fe1 req-5c04d669-0112-427a-ac1f-e6f950f59e72 service nova] Enqueued Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 736.005828] env[65469]: INFO networking_nsxv3.common.synchronization [req-d283119a-e519-4848-aaf5-7bf9eae02fe1 req-5c04d669-0112-427a-ac1f-e6f950f59e72 service nova] Enqueued Resource ID: c39af72b-1658-45f4-92cd-1aa943f1e679 with Priority: HIGHEST for action port [ 736.006519] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_rules [ 736.006668] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 736.006857] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39af72b-1658-45f4-92cd-1aa943f1e679 with Priority: HIGHEST for action port [ 736.007233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.007359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.007423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.007677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.007761] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.008696] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.008801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.008880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.009076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.009228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.009356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.009445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.009615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.009703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.009799] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.010997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c39af72b-1658-45f4-92cd-1aa943f1e679 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.011446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.011446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.011607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.011686] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c39af72b-1658-45f4-92cd-1aa943f1e679',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.091537] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.158312] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 736.160048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.160048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.160048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.161310] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.513925] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.515770] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.515770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.516987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c39af72b-1658-45f4-92cd-1aa943f1e679 with status ACTIVE [ 736.516987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.516987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.516987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.517884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.517884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.517884] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.518994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.518994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.519841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.519841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.519841] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.519841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.519841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.520237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.521450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.521450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c39af72b-1658-45f4-92cd-1aa943f1e679 is going to be updated. [ 736.542220] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.542384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.542469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.542702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.542837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.542992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c39af72b-1658-45f4-92cd-1aa943f1e679" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.594353] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.663740] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.664184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.664184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.664184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.664438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.664438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.664590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.664654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.664735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.664814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.664906] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.960384] env[65469]: INFO networking_nsxv3.common.synchronization [None req-b3f37009-3077-446c-a224-0b9bc98f14a9 None None] Enqueued Resource ID: 18bdf8ae-0738-42c5-b8ea-98824aa26b40 with Priority: HIGHEST for action port [ 736.960924] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bdf8ae-0738-42c5-b8ea-98824aa26b40 with Priority: HIGHEST for action port [ 736.961232] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-18bdf8ae-0738-42c5-b8ea-98824aa26b40 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.961357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18bdf8ae-0738-42c5-b8ea-98824aa26b40" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.961425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18bdf8ae-0738-42c5-b8ea-98824aa26b40" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.961675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18bdf8ae-0738-42c5-b8ea-98824aa26b40" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.961756] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18bdf8ae-0738-42c5-b8ea-98824aa26b40',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.016023] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.096836] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.097012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.097090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.097309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.097396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 737.135629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.135814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.135904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.136309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.137855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.149064] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 737.167099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.167508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.167508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.167658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.167825] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.167927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.167990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.168202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.168353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.168447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.168653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.168817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.168817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.168949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.169128] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.169254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.169322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.169462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.169569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.169790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.169790] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.465432] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18bdf8ae-0738-42c5-b8ea-98824aa26b40 [ 737.465693] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.465829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.465913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.466149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.466278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.466324] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18bdf8ae-0738-42c5-b8ea-98824aa26b40 already deleted. [ 737.466402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18bdf8ae-0738-42c5-b8ea-98824aa26b40" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.524034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.524034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.524034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.524034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.524034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.524034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31117731-2c40-474a-b432-88e9d4361256 is going to be created. [ 737.549234] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.549234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.549234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.549234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.549234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.563151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: UNINITIALIZED for 2s [ 737.674361] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee1b710f-8b96-44eb-b935-7e6dcdbe6f18: rpc.has_security_group_logging(os_id): False [ 737.692792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.692993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.693087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.693306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.693443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.693616] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.693761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.693795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.694011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.694011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.695014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.695014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.695014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.695722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.695837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.695902] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 737.762294] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.762294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.762294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.762294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.762294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.773928] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 737.891788] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 737.892098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.932324] env[65469]: INFO networking_nsxv3.common.synchronization [req-a14a7aad-3c40-48ed-8f75-891b0896c2f2 req-ddf9c700-85c4-489a-8e8b-f49fea720ab8 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 737.933019] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 737.933368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.934017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.934017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.934017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.934142] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.934227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.934299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.934473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.934563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.934662] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.450316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.450316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.450316] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c already deleted. [ 738.450316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.806071] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.806727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.806727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.806727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807024] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.807636] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.807636] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.807742] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807898] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.808109] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.808214] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.808345] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.808675] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.809023] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.809023] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.809109] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.830739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.830928] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.831087] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.831311] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-136" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.831704] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-06b804b4-7228-4747-8233-5e31c2eb4b1d taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.831965] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.832156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.832539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.832759] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b804b4-7228-4747-8233-5e31c2eb4b1d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.161609] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 739.161609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.161609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.165027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.165027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.165027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.337378] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.337714] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.337777] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.338016] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.338153] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.338339] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 06b804b4-7228-4747-8233-5e31c2eb4b1d not found, creating... [ 739.338738] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.338847] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.339073] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.339834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.339834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.339834] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.339956] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.340574] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.340704] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.340896] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.341085] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 06b804b4-7228-4747-8233-5e31c2eb4b1d is going to be created. [ 739.364119] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.364311] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.364395] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.364711] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.364939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.365294] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.573755] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: SUCCESS [ 739.574043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.574240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.574542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.574938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.575055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.575102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.575313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.575447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.575582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.575756] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.650136] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c36af2cf-2c75-417e-8ba2-38b9669fe161 None None] Enqueued Resource ID: 331f1140-2929-40ce-98e2-0e46ff7c2212 with Priority: HIGHEST for action port [ 739.650824] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331f1140-2929-40ce-98e2-0e46ff7c2212 with Priority: HIGHEST for action port [ 739.650988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-331f1140-2929-40ce-98e2-0e46ff7c2212 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.652528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-331f1140-2929-40ce-98e2-0e46ff7c2212" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.652632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-331f1140-2929-40ce-98e2-0e46ff7c2212" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.654562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-331f1140-2929-40ce-98e2-0e46ff7c2212" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.654562] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('331f1140-2929-40ce-98e2-0e46ff7c2212',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.666586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.666586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.666586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.667014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.667203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.667337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.667406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.667727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.669051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.669051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.669051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.670936] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.791498] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 739.791765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.078963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.079277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.079352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.079691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.079944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.080150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.080208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.080420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.080570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.080662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.080925] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.081037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.081139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.081370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.081487] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.081636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.081711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.081922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.082060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.082186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.082303] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.157054] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 331f1140-2929-40ce-98e2-0e46ff7c2212 [ 740.157278] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.157427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.157510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.157729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.157818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.157910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:331f1140-2929-40ce-98e2-0e46ff7c2212 already deleted. [ 740.157993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-331f1140-2929-40ce-98e2-0e46ff7c2212" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.173048] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 740.179059] env[65469]: INFO networking_nsxv3.common.synchronization [req-a14a7aad-3c40-48ed-8f75-891b0896c2f2 req-6a484ea0-bb0b-4890-8cc1-7219c1d32d78 service nova] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 740.179059] env[65469]: INFO networking_nsxv3.common.synchronization [req-a14a7aad-3c40-48ed-8f75-891b0896c2f2 req-6a484ea0-bb0b-4890-8cc1-7219c1d32d78 service nova] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 740.179059] env[65469]: INFO networking_nsxv3.common.synchronization [req-a14a7aad-3c40-48ed-8f75-891b0896c2f2 req-6a484ea0-bb0b-4890-8cc1-7219c1d32d78 service nova] Enqueued Resource ID: 06b804b4-7228-4747-8233-5e31c2eb4b1d with Priority: HIGHEST for action port [ 740.180273] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_rules [ 740.180428] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 740.180508] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b804b4-7228-4747-8233-5e31c2eb4b1d with Priority: HIGHEST for action port [ 740.180850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.180977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.181325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.181555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.181644] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.182756] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.182910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.183038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.183243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.183402] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.183579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.183579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.183744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.183869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.183946] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.184764] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b804b4-7228-4747-8233-5e31c2eb4b1d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.184898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.185154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.185377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.185474] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b804b4-7228-4747-8233-5e31c2eb4b1d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.200046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.201065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.201184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.201315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.201411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.201623] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.201730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.201794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.201946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.202379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.202379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.202379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.202379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.202561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.202602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.202811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.202891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.202891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.203041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.203135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.203334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 740.302254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.302455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.302455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.303331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.303331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.335739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 740.585903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31117731-2c40-474a-b432-88e9d4361256: rpc.has_security_group_logging(os_id): False [ 740.609259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.609381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.609459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.609678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.609767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.609972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.610753] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.610753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.611316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.611316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.611316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.611316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.611316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.611489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.611489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.611550] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31117731-2c40-474a-b432-88e9d4361256 is going to be created. [ 740.687600] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.689711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.689711] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.689711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06b804b4-7228-4747-8233-5e31c2eb4b1d with status ACTIVE [ 740.689711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.689711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.689711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.689711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.689711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.690178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.690178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.690178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.690178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.690178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.693564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.693564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.693564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.693564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.693564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.693564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06b804b4-7228-4747-8233-5e31c2eb4b1d is going to be updated. [ 740.703026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.703026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.703026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.703026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.703776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.722407] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: IN_PROGRESS for 2s [ 740.724904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.724904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.725082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.725471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.725593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.725909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b804b4-7228-4747-8233-5e31c2eb4b1d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.195192] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.454216] env[65469]: INFO networking_nsxv3.common.synchronization [req-e558055d-5ebe-4a6b-a73e-396b9f41060a req-4fd76bd0-b62c-47ff-82cc-709eeb3befae tempest-AttachInterfacesV270Test-612510472 tempest-AttachInterfacesV270Test-612510472-project-member] Enqueued Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 741.454216] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGHEST for action security_group_members [ 741.454446] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.454576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.454642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.454880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.455097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.455231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.455272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.455444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.455527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.455647] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.697983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.698352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.698352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.698594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.698594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.698689] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c is going to be created. [ 741.701989] env[65469]: INFO networking_nsxv3.common.synchronization [req-fcb8d575-f918-465c-8e8f-4d4531a6e3c4 req-6a3514b4-5f6d-403d-95af-ae8c524b9dc0 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 741.703382] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 741.703382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.703382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.703563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.703625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.704214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.704214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.704214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.704214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.704214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.704214] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.730719] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.730719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.730719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.730863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.732423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.745710] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: UNINITIALIZED for 2s [ 741.959966] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.959966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.959966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.960183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.960183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.960777] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.960777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.960777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.960937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.960972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.961077] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 is going to be updated. [ 741.994127] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.994639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.994768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.995035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.995203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.005095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: IN_PROGRESS for 2s [ 742.207061] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.304941] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.305157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.305277] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.305539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.305784] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.305933] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.306372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.306764] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.306999] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.307330] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.307531] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.307667] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.307773] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.307882] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.307979] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.308113] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.333770] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.333948] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.334090] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.334243] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-269" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.334565] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-bea18d41-0f11-4e1a-81c1-050988de471c taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.334761] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.334861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.335231] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.335421] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea18d41-0f11-4e1a-81c1-050988de471c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.354410] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 742.354410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.710341] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.737298] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: SUCCESS [ 742.737298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.837551] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.837882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.837956] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.838526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.838526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.838736] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port bea18d41-0f11-4e1a-81c1-050988de471c not found, creating... [ 742.838879] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.839052] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.839167] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.839428] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.839573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.839864] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.840045] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.840161] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.840371] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.840503] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.840640] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: bea18d41-0f11-4e1a-81c1-050988de471c is going to be created. [ 742.863968] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.864550] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.864700] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.865423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.865423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.865606] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.213383] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.213383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.213383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.213582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.213967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.213967] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 743.246130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.246288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.246360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.246571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.246721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.256222] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 743.642605] env[65469]: INFO networking_nsxv3.common.synchronization [req-fcb8d575-f918-465c-8e8f-4d4531a6e3c4 req-2de88c98-8a24-4349-b3f1-b0b5f04bb566 service nova] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 743.642714] env[65469]: INFO networking_nsxv3.common.synchronization [req-fcb8d575-f918-465c-8e8f-4d4531a6e3c4 req-2de88c98-8a24-4349-b3f1-b0b5f04bb566 service nova] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 743.642856] env[65469]: INFO networking_nsxv3.common.synchronization [req-fcb8d575-f918-465c-8e8f-4d4531a6e3c4 req-2de88c98-8a24-4349-b3f1-b0b5f04bb566 service nova] Enqueued Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 743.643363] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 743.643496] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 743.643591] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 743.644201] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.644365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.644463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.645331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.645331] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.645911] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.646578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.646578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea18d41-0f11-4e1a-81c1-050988de471c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.646578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.646578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.646789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.646789] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea18d41-0f11-4e1a-81c1-050988de471c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.759179] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: SUCCESS [ 743.759179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.759179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.759511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.759584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.759770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.759840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.762579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.762579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.762716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.762842] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.019076] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 in Status: SUCCESS [ 744.019674] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 deletion is rescheduled due to dependency. [ 744.019864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.150814] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.151148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.151343] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bea18d41-0f11-4e1a-81c1-050988de471c with status ACTIVE [ 744.151552] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.151677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.151868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.152549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.152660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.153203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.154246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.154246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.154416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.154503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.154972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.155100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.155227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.155686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.157885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.159561] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bea18d41-0f11-4e1a-81c1-050988de471c is going to be updated. [ 744.200847] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.200847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.200847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.201199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.202753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.203200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.268640] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.329286] env[65469]: INFO networking_nsxv3.common.synchronization [req-09e500ab-d9da-4ff7-b9f8-f4ed9219710c req-2bbc13c5-1d57-4d7d-9cfe-886ee357ed1f tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 744.329286] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 744.329286] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.329286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.329286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.329286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.330185] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.332238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.333248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.334057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.334057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.334057] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.772324] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1fe9c7b-391a-4964-94bd-fd69c7fb232c: rpc.has_security_group_logging(os_id): False [ 744.792848] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.793050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.793050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.793326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.793422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.793669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.793768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.793818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.793967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.794057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.794146] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c is going to be created. [ 744.836607] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.836884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.837011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.837329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.837479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.837689] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.837847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.837935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.838139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.838293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.838381] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 already deleted. [ 744.838508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.866352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.866594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.866678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.867096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.867258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.879520] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: IN_PROGRESS for 2s [ 744.961156] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.961156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.961156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.961156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.961156] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.961156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.961156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.961609] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.961873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.962302] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.962506] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.962777] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.962964] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.963178] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.963495] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.963760] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.102231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.102231] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.137 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.102231] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.102231] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.103296] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a626779f-33da-40a2-8412-7bb79ac2038b taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.104399] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.105794] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.105794] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.105794] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a626779f-33da-40a2-8412-7bb79ac2038b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.272270] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 745.272270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.272502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.272580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.272914] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.273081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.273081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.273935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.275608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.275787] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.609954] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.609954] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.609954] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.609954] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.610204] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.610204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a626779f-33da-40a2-8412-7bb79ac2038b not found, creating... [ 745.610457] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.610610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.610767] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.610991] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.611136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.611412] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.611564] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.611676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.611875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.612007] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.612147] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a626779f-33da-40a2-8412-7bb79ac2038b is going to be created. [ 745.634741] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.634978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.635088] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.635361] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.635585] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.635830] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.651145] env[65469]: INFO networking_nsxv3.common.synchronization [req-9246dfe4-f6fd-44ff-b969-043eed330768 req-db679285-2607-4249-987f-d4fed62b07aa tempest-FloatingIPsAssociationNegativeTestJSON-886561089 tempest-FloatingIPsAssociationNegativeTestJSON-886561089-project-member] Enqueued Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 745.651667] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGHEST for action security_group_members [ 745.651974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.652236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.652325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.652505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.652666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.652748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.652931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.653044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.653124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.653212] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.779697] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.155578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.156386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.156386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.156386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.156386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.156597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.156707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.156769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.156933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.157053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.157094] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c is going to be updated. [ 746.190300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.190508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.190567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.190812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.191030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.200834] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: IN_PROGRESS for 2s [ 746.269167] env[65469]: INFO networking_nsxv3.common.synchronization [req-09e500ab-d9da-4ff7-b9f8-f4ed9219710c req-bf511cc1-08fd-42d3-abd4-e41fc1f2be8c service nova] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_rules [ 746.270470] env[65469]: INFO networking_nsxv3.common.synchronization [req-09e500ab-d9da-4ff7-b9f8-f4ed9219710c req-bf511cc1-08fd-42d3-abd4-e41fc1f2be8c service nova] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 746.270470] env[65469]: INFO networking_nsxv3.common.synchronization [req-09e500ab-d9da-4ff7-b9f8-f4ed9219710c req-bf511cc1-08fd-42d3-abd4-e41fc1f2be8c service nova] Enqueued Resource ID: a626779f-33da-40a2-8412-7bb79ac2038b with Priority: HIGHEST for action port [ 746.270470] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_rules [ 746.270470] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 746.270470] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a626779f-33da-40a2-8412-7bb79ac2038b with Priority: HIGHEST for action port [ 746.270801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.270801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.270945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.271922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.271922] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.272147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.272266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.272322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.273098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.273098] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.273098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.273098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.273098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.273098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.273399] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.273932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a626779f-33da-40a2-8412-7bb79ac2038b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.274046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.274108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.274280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.274357] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a626779f-33da-40a2-8412-7bb79ac2038b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.285316] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.776038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.776232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.776407] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.777513] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a626779f-33da-40a2-8412-7bb79ac2038b with status ACTIVE [ 746.777614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.777706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.777778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.778077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.778077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.778231] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.778402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.778984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.778984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.778984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.778984] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.778984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.779209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.779209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.779293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.779415] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a626779f-33da-40a2-8412-7bb79ac2038b is going to be updated. [ 746.784481] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.784822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.784822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.784895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.785702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.785702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 746.815623] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.815866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.815866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.816031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.816172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.816338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a626779f-33da-40a2-8412-7bb79ac2038b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.862546] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.862749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.863119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.863434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.863664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.874347] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 746.900982] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: SUCCESS [ 746.901196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.281761] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.784583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.784915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.784915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.784981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.785196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.785365] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be created. [ 747.821863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.822135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.822135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.823681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.823681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.836985] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: UNINITIALIZED for 2s [ 748.212202] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56fa7160-9619-4025-888c-7ea4b50f157c in Status: SUCCESS [ 748.212202] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c deletion is rescheduled due to dependency. [ 748.212202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.661992] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ead75431-3c59-4633-aaf8-35f7d5018eb0 None None] Enqueued Resource ID: 77dcb2c0-b501-4802-9840-65d87e233b9b with Priority: HIGHEST for action port [ 748.661992] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dcb2c0-b501-4802-9840-65d87e233b9b with Priority: HIGHEST for action port [ 748.661992] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-77dcb2c0-b501-4802-9840-65d87e233b9b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.662251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77dcb2c0-b501-4802-9840-65d87e233b9b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.662251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77dcb2c0-b501-4802-9840-65d87e233b9b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.663166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77dcb2c0-b501-4802-9840-65d87e233b9b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.663166] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77dcb2c0-b501-4802-9840-65d87e233b9b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.730359] env[65469]: INFO networking_nsxv3.common.synchronization [req-a19ba322-470f-485d-a1e8-fb173284d248 req-07ea4c3c-e3af-4cb5-977e-26e37093edbe tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 748.732150] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 748.733258] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.733258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.733258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.733258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.733258] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.733258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.733542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.735332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.735442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.735570] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.884635] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 748.884963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.884999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.885261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.885456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.887155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.887155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.887155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.887155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.887155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.887155] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.166690] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77dcb2c0-b501-4802-9840-65d87e233b9b [ 749.167228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.167426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.167559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.168638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.168888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.168997] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77dcb2c0-b501-4802-9840-65d87e233b9b already deleted. [ 749.169182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77dcb2c0-b501-4802-9840-65d87e233b9b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.238983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.239120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.239190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.239386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.239554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.239929] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.240035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.240092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.240238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.240319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.240585] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 749.270074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.270244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.270545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.270981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.271225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.283673] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 749.390878] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.391070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.391122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.391394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.391541] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.391655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.391728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.391900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.391999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.392111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.392259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.392352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.392412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.392556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.392693] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.392792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.392854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.392993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.393093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.393173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.393262] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.812421] env[65469]: INFO networking_nsxv3.common.synchronization [req-09fe857d-6b1d-42cf-b8a3-e2c0fa40cd6e req-edaa8c55-ad3e-4df9-b4bc-5fdf8a55fad0 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 749.813273] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 749.813533] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.813647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.813815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.814150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.814322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.814424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.814493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.814699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.814819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.814916] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.849671] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 749.849671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.849671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.849906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.850060] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.850204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.850247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.850391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.850549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.850549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.850723] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.899095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 749.917877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.918138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.918138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.918308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.918425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.918691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.918691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.919286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.919286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.919286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.919286] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.919286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.919659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.919659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.919659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.919820] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.919916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.919982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.920157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.920236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.920322] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 750.000177] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.000457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.001042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.001042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.001042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.028343] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 750.320643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.320643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.320643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.320643] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 750.353737] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.354067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.354067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.354364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.355056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.355056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.355056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.355056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.355056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.355384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.355384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.355384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.355384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.355512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.355703] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.355765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.355941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.356847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.356847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.356847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.356847] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.360185] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.360345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.360503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.360744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.361032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.374848] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 750.860610] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dac16e76-d38a-4051-af09-b9b6e58acda0: rpc.has_security_group_logging(os_id): False [ 750.891360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.891360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.891360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.891360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.892046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.892046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.892046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.892046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.892046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.892046] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be created. [ 750.973030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.973030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.973030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.973030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.973030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.988886] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: IN_PROGRESS for 2s [ 751.298624] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 751.298944] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 751.299126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.384146] env[65469]: INFO networking_nsxv3.common.synchronization [None req-030c8890-5b6e-4e20-a60d-5ead6991fda2 None None] Enqueued Resource ID: 3cd401c6-f799-4bd3-a84f-7512724422de with Priority: HIGHEST for action port [ 751.387187] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd401c6-f799-4bd3-a84f-7512724422de with Priority: HIGHEST for action port [ 751.387187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd401c6-f799-4bd3-a84f-7512724422de taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.387187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd401c6-f799-4bd3-a84f-7512724422de" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.387187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd401c6-f799-4bd3-a84f-7512724422de" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.387937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd401c6-f799-4bd3-a84f-7512724422de" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.387937] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd401c6-f799-4bd3-a84f-7512724422de',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.894766] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cd401c6-f799-4bd3-a84f-7512724422de [ 751.895070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.895446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.895446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.896369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.896529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.896696] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cd401c6-f799-4bd3-a84f-7512724422de already deleted. [ 751.897207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd401c6-f799-4bd3-a84f-7512724422de" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.048983] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 752.049328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.387614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 752.387870] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 752.387988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.515808] env[65469]: INFO networking_nsxv3.common.synchronization [req-bdf86d28-01de-4768-a352-ca0eb0987174 req-56b63429-c1f6-4a19-a733-fd60fbef8318 tempest-VolumesAssistedSnapshotsTest-325735266 tempest-VolumesAssistedSnapshotsTest-325735266-project-member] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 752.516679] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGHEST for action security_group_members [ 752.519174] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.519174] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.519174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.519174] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.841511] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c74cc9ee-6c34-4332-8d97-18b7f6e3a528 None None] Enqueued Resource ID: ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5 with Priority: HIGHEST for action port [ 752.845084] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5 with Priority: HIGHEST for action port [ 752.846183] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.846413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.846413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.846723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.846771] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.008308] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 753.008308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.027027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.027027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.027027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.027027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 is going to be updated. [ 753.061675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.061675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.061675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.061675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.061675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.074577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: IN_PROGRESS for 2s [ 753.169803] env[65469]: INFO networking_nsxv3.common.synchronization [req-8cbe499f-20dd-4122-8288-61a7d22cf683 req-63149d52-184f-4f01-b799-8d0e77b11621 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 753.173538] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 753.178423] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.179372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.179372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.179372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.179372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.179632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.179632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.179776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.179776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.179911] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.349816] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5 [ 753.352587] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.352587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.352587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.352587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.352587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.352587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5 already deleted. [ 753.352587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad825a78-a6e0-4e7f-9c84-aceefb0ee0d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.682691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.682876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.682961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.683819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.683819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.683819] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.683819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.683819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.684224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.684224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.684291] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b already deleted. [ 753.684383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.687189] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.688117] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.688117] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.688117] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.688117] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.688379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.688379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.688619] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.688756] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.688988] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.690942] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.691114] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.692104] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.692104] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.692104] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.692104] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.718091] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.718091] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.718091] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.718091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.718091] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-9c745cda-7fd8-476d-8653-3da3e6c7a217 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.718091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.718091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.718616] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.718616] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c745cda-7fd8-476d-8653-3da3e6c7a217',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.224332] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.224332] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 9c745cda-7fd8-476d-8653-3da3e6c7a217 not found, creating... [ 754.224332] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.224332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.224980] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.226702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.226702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.226702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.226702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.226702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 9c745cda-7fd8-476d-8653-3da3e6c7a217 is going to be created. [ 754.253958] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.254274] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.254430] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.255175] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.256103] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.256655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.053051] env[65469]: INFO networking_nsxv3.common.synchronization [req-8cbe499f-20dd-4122-8288-61a7d22cf683 req-28eae1d2-730b-49d5-ada2-f75d20de9b77 service nova] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 755.053436] env[65469]: INFO networking_nsxv3.common.synchronization [req-8cbe499f-20dd-4122-8288-61a7d22cf683 req-28eae1d2-730b-49d5-ada2-f75d20de9b77 service nova] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 755.053436] env[65469]: INFO networking_nsxv3.common.synchronization [req-8cbe499f-20dd-4122-8288-61a7d22cf683 req-28eae1d2-730b-49d5-ada2-f75d20de9b77 service nova] Enqueued Resource ID: 9c745cda-7fd8-476d-8653-3da3e6c7a217 with Priority: HIGHEST for action port [ 755.053921] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_rules [ 755.054129] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 755.054273] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c745cda-7fd8-476d-8653-3da3e6c7a217 with Priority: HIGHEST for action port [ 755.054544] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.055377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.055494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.055712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.057029] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.058752] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.059427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.059470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.060428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.060428] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.060428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.060428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.060428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.060428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.060428] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.063043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c745cda-7fd8-476d-8653-3da3e6c7a217 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.063043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.063043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.063043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.063043] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c745cda-7fd8-476d-8653-3da3e6c7a217',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.093414] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92bf433d-c39b-4344-960c-b8e0607c3036 in Status: SUCCESS [ 755.093556] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 deletion is rescheduled due to dependency. [ 755.093658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.565545] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c745cda-7fd8-476d-8653-3da3e6c7a217 with status ACTIVE [ 755.565845] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.565953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.566001] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.566224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.566377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.567582] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.567706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.567818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.567929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.568064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.568279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.568395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.568577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.568642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.568696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.568783] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c745cda-7fd8-476d-8653-3da3e6c7a217 is going to be updated. [ 755.571131] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.572362] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.572362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.597339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.597558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.597558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.597764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.597939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.598244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c745cda-7fd8-476d-8653-3da3e6c7a217" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.685677] env[65469]: INFO networking_nsxv3.common.synchronization [req-c3fd56fc-933c-42f5-9d7e-fda00309b9d4 req-95ea1b70-6c5b-4d9d-bcd6-2942682f180b tempest-ServerActionsV293TestJSON-298286975 tempest-ServerActionsV293TestJSON-298286975-project-member] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 755.687073] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGHEST for action security_group_members [ 755.687549] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.688331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.688331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.688600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.689037] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.689037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.689037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.689235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.689235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.689312] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.717916] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9018d573-fce2-419e-9553-68207f1ed6ee None None] Enqueued Resource ID: c49c4151-8f2b-4c49-869f-e1ffed3cb82e with Priority: HIGHEST for action port [ 755.718752] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49c4151-8f2b-4c49-869f-e1ffed3cb82e with Priority: HIGHEST for action port [ 755.719453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c49c4151-8f2b-4c49-869f-e1ffed3cb82e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.719647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c49c4151-8f2b-4c49-869f-e1ffed3cb82e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.719806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c49c4151-8f2b-4c49-869f-e1ffed3cb82e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.720101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c49c4151-8f2b-4c49-869f-e1ffed3cb82e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.720191] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c49c4151-8f2b-4c49-869f-e1ffed3cb82e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.753682] env[65469]: INFO networking_nsxv3.common.synchronization [req-3ede13d2-9a84-4512-a42d-fc7e3e0a71d9 req-440e9710-f1ac-4c6c-b627-868e6109c9ce tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 755.754431] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 755.756076] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.756076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.756076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.756215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.756751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.756751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.756751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.756751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.756751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.757472] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.076241] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.191926] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.191926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.192821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.192821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.192821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.192821] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.192821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.192821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.193027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.193559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.193559] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae is going to be updated. [ 756.224060] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c49c4151-8f2b-4c49-869f-e1ffed3cb82e [ 756.224060] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.224060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.224060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.224287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.224287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.224343] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c49c4151-8f2b-4c49-869f-e1ffed3cb82e already deleted. [ 756.224434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c49c4151-8f2b-4c49-869f-e1ffed3cb82e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.230696] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.230696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.230696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.230696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.230696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.244660] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: IN_PROGRESS for 2s [ 756.262018] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.581032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.581032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.581032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.581536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.581536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.581536] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b is going to be created. [ 756.607235] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.607235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.607645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.607722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.607935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.623223] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: UNINITIALIZED for 2s [ 756.765499] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.268310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.268680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.268961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.273032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.273032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.273032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 757.340124] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.340333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.340407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.340728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.340967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.355313] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 757.780381] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 757.780783] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 757.781556] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 757.781749] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 757.782195] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.782397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.782531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.783198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.783477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.783909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.783909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.784056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.784304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.784391] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.785732] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.785915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.786050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.786534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.786632] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.786722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.786999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.787099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.787267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.787399] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.830765] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_rules [ 757.830991] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 757.832814] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 757.833560] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 757.833560] env[65469]: INFO networking_nsxv3.common.synchronization [req-a9b6bc25-e786-4f76-9df4-d5ab8557ca12 req-36b9363f-c9d0-4092-af80-b6c10fc0d7f9 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 757.834188] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_rules [ 757.834188] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 757.834290] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 757.834809] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 757.834809] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 757.834809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.835184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.835184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.835453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.835543] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.837328] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.837457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.837528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.837719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.837796] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.838727] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea18d41-0f11-4e1a-81c1-050988de471c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.838847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.838932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.839173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.839281] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea18d41-0f11-4e1a-81c1-050988de471c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.843774] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.843951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.844215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.844305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.260088] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae in Status: SUCCESS [ 758.260088] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae deletion is rescheduled due to dependency. [ 758.260362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.290963] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.291956] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.346249] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.346957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.346957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.346957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.346957] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bea18d41-0f11-4e1a-81c1-050988de471c with status ACTIVE [ 758.347430] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.347430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.347430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.347773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.347773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.347773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.347889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.347889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.348047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.348122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.348343] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.348398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.348491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.348667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.348774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.351370] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bea18d41-0f11-4e1a-81c1-050988de471c is going to be updated. [ 758.376444] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.376528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.376752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.376791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.376951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.377394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.638476] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: SUCCESS [ 758.638476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.638710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.639545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.639545] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.639545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.639545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.640761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.640761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.640761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.640761] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.793777] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.794843] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.029556] env[65469]: INFO networking_nsxv3.common.synchronization [req-e6a4baea-e1a5-45a8-a05a-4a20a8b5532c req-b62656da-0887-4575-8af0-c006280dc555 tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 759.033148] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 759.033148] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.033148] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.033797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.033908] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.149846] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.296706] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.297088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.297088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.297396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.297396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.297518] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be created. [ 759.299767] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.299921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.299974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.300210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.300832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.300832] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 759.337252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.337395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.337483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.337660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.337823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.340997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.341145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.341215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.341411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.341552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.351293] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: UNINITIALIZED for 2s [ 759.351293] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 759.364514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 759.364514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.507625] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.507625] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.507625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.507625] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.507625] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.507625] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.507625] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.508104] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.508104] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.508104] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.531819] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.531994] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.532144] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.532513] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.532833] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-3451b41f-f78d-4c78-945c-42d0731999b4 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.533008] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.533137] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.533440] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.533575] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3451b41f-f78d-4c78-945c-42d0731999b4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.539576] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.539576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.539576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.539778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.539778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.539951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.540056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.540121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.540274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.540351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.540435] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a already deleted. [ 759.540512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.652871] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ad20fef-905e-4efe-bdf9-75c98decc63b: rpc.has_security_group_logging(os_id): False [ 759.672735] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.672735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.672735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.672735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.673064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.673064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.673274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.673274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.673483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.673483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.673560] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b is going to be created. [ 759.744704] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.744846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.744892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.745098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.745425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.757118] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: IN_PROGRESS for 2s [ 760.035886] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.035886] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.036545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.036545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.036545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.036761] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 3451b41f-f78d-4c78-945c-42d0731999b4 not found, creating... [ 760.037120] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.037321] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.037407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.037656] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.037836] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038114] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.038274] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.038383] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.038681] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.038816] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038989] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 3451b41f-f78d-4c78-945c-42d0731999b4 is going to be created. [ 760.062831] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.063180] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.063180] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.063449] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.063670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.063903] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.822669] env[65469]: INFO networking_nsxv3.common.synchronization [req-e6a4baea-e1a5-45a8-a05a-4a20a8b5532c req-bdf0f6e0-0832-4d46-8aa7-baac168605cb service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 760.822956] env[65469]: INFO networking_nsxv3.common.synchronization [req-e6a4baea-e1a5-45a8-a05a-4a20a8b5532c req-bdf0f6e0-0832-4d46-8aa7-baac168605cb service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 760.823145] env[65469]: INFO networking_nsxv3.common.synchronization [req-e6a4baea-e1a5-45a8-a05a-4a20a8b5532c req-bdf0f6e0-0832-4d46-8aa7-baac168605cb service nova] Enqueued Resource ID: 3451b41f-f78d-4c78-945c-42d0731999b4 with Priority: HIGHEST for action port [ 760.823808] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 760.828306] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 760.828886] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3451b41f-f78d-4c78-945c-42d0731999b4 with Priority: HIGHEST for action port [ 760.830274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.830455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.830531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.830928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.830928] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.833522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.833655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.833721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.833959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.834812] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.834945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.835044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.835222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.835311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.835438] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.837390] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3451b41f-f78d-4c78-945c-42d0731999b4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.837507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.837576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.837883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.837994] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3451b41f-f78d-4c78-945c-42d0731999b4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.301228] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8aaa850c-66ab-4e95-b121-ddd01395bf22 None None] Enqueued Resource ID: 55f88f4c-271e-4e48-a7c9-0667bfb1b8d4 with Priority: HIGHEST for action port [ 761.302877] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f88f4c-271e-4e48-a7c9-0667bfb1b8d4 with Priority: HIGHEST for action port [ 761.302877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f88f4c-271e-4e48-a7c9-0667bfb1b8d4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.302877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f88f4c-271e-4e48-a7c9-0667bfb1b8d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.302877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f88f4c-271e-4e48-a7c9-0667bfb1b8d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.302877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f88f4c-271e-4e48-a7c9-0667bfb1b8d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.302877] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f88f4c-271e-4e48-a7c9-0667bfb1b8d4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.341034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3451b41f-f78d-4c78-945c-42d0731999b4 with status ACTIVE [ 761.341034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.341229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.341229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.341439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.341532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341705] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.341799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.341859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.342015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.342092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.342285] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.342354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.342414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.342545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.342618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.342699] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3451b41f-f78d-4c78-945c-42d0731999b4 is going to be updated. [ 761.343910] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.344057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.345135] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.386907] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 761.387183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.388095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 761.388221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.388402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.388673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.391981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.391981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.391981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.391981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.392508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.392508] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.393369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.393589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.393805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.395411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.395529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.396087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.396371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.396774] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.407384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.407580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.407645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.408094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.408094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.408871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3451b41f-f78d-4c78-945c-42d0731999b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.777058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: SUCCESS [ 761.777058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.807021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55f88f4c-271e-4e48-a7c9-0667bfb1b8d4 [ 761.808979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.808979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.808979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.808979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.808979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.808979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55f88f4c-271e-4e48-a7c9-0667bfb1b8d4 already deleted. [ 761.808979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f88f4c-271e-4e48-a7c9-0667bfb1b8d4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.849630] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.861113] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-4b39e409-0f17-465a-ab49-b2e91bd6fdf3 tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 761.863136] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 761.863513] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.863676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.863716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.864170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.864170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.864319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.864319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.864475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.864562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.864661] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.906075] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.906075] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.320045] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-5b038fc7-7a22-4b30-9ee8-1add3328d2de tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 762.320802] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 762.321788] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.321975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.353284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.353467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.353531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.353751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.353847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.353944] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be created. [ 762.368725] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.368924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.368924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.369124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.369241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.369455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.369660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.369660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.369789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.369867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.369971] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 already deleted. [ 762.370061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.370242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.370386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.370614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.370614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.370704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.371013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.371013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.371082] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.380628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.380825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.380871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.381153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.381320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.394954] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: UNINITIALIZED for 2s [ 762.406243] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.407704] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.878951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.878951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.878951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.879115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.879146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.880417] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.880417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.880417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.880417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.880417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.880417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 already deleted. [ 762.880417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.910947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.910947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.910947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.911190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.911303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.911424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be updated. [ 762.912867] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.913032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.913095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.913297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.913422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.913509] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 762.944021] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c15ea5f9-272b-4e3a-83bf-f7f45ef13eef tempest-ServersTestJSON-1003188530 tempest-ServersTestJSON-1003188530-project-member] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 762.944021] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 762.948062] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.948062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.948062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.948062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.948062] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.950993] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.952422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.952422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.952422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.952422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.954110] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.954315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.954536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.954731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.966804] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 762.967551] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 763.132029] env[65469]: INFO networking_nsxv3.common.synchronization [None req-cb860285-8708-4a70-a97d-b58a47f60571 tempest-ServersTestJSON-1003188530 tempest-ServersTestJSON-1003188530-project-member] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 763.132809] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 763.132983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.133158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.240446] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-b81098d9-9341-4185-920e-8c4ec20dd48c tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 763.244194] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 763.244648] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.244792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.244867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.245159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.245371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.247125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.247280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.247500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.247664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.247764] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.477773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.478572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.478685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.478903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.478996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.479114] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb already deleted. [ 763.479198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.479357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.479527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.483599] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.627419] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.627666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.627797] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.628162] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.628462] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.628666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.628800] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.629136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.629648] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.629648] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.629756] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.629803] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.629911] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.630068] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.630184] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.630338] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.650982] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.651202] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.651413] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.651494] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.651838] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.652502] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.652709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.652996] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.653311] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.750984] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.751225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.751303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.751546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.751657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.751956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.751956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.752100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.752527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.752527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.752527] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 already deleted. [ 763.752527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.903146] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7af1fa0c-9c33-4e25-9f57-5c3008fd5b70 None None] Enqueued Resource ID: 9e34f4ba-6212-4fe4-9338-f91dc1cbee26 with Priority: HIGHEST for action port [ 763.904141] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e34f4ba-6212-4fe4-9338-f91dc1cbee26 with Priority: HIGHEST for action port [ 763.904190] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e34f4ba-6212-4fe4-9338-f91dc1cbee26 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.904324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e34f4ba-6212-4fe4-9338-f91dc1cbee26" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.904410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e34f4ba-6212-4fe4-9338-f91dc1cbee26" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.904728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e34f4ba-6212-4fe4-9338-f91dc1cbee26" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.904839] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e34f4ba-6212-4fe4-9338-f91dc1cbee26',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.015083] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.015083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.015083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.015610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.015610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.015610] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb already deleted. [ 764.015610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.156190] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.156495] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.156631] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.156910] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.157063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.157300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe not found, creating... [ 764.157664] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.157856] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.157988] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.158283] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.158418] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.158818] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.159021] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.159171] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.159382] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.159564] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.159732] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe is going to be created. [ 764.184096] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.184734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.184897] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.186322] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.186930] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.407652] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e34f4ba-6212-4fe4-9338-f91dc1cbee26 [ 764.407898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.408043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.408124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.408405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.408580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.408681] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e34f4ba-6212-4fe4-9338-f91dc1cbee26 already deleted. [ 764.408766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e34f4ba-6212-4fe4-9338-f91dc1cbee26" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.414836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 764.415100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.415276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.415579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.415793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.415793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.415935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.416026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.416102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.416186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.416278] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.893681] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-2dcc013f-ad69-4737-94de-cfb7e6ee4be8 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 764.893934] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-2dcc013f-ad69-4737-94de-cfb7e6ee4be8 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 764.893996] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-2dcc013f-ad69-4737-94de-cfb7e6ee4be8 service nova] Enqueued Resource ID: dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe with Priority: HIGHEST for action port [ 764.894517] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 764.894685] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 764.894789] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe with Priority: HIGHEST for action port [ 764.897955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.898127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.898198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.898462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.898577] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.900856] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.900959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.901047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.902035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.902162] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.902463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.902463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.902463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.902568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.902617] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.904595] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.904595] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.919160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.919327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.919387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.919581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.919742] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.920225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.920303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.920475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.920606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.920649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.921097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.921097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.921097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.921303] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.921303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.921424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.921772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.921772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921772] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.979326] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 764.979326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.979326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.979326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.979326] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.979326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.979844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.979844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.979844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.979844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.980064] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.984126] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 764.984126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.984126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.984126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.984126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.984126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.984126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.984478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.984478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.984478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.984630] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.343597] env[65469]: INFO networking_nsxv3.common.synchronization [req-e26cd4e4-4575-4ca8-9d6a-8162718f984d req-4376ae79-e68a-4bce-a599-ec2596cd9b0f tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 765.344652] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 765.346028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.346278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.346404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.347407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.347407] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.347766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.347831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.348481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.348481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.348481] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.402614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.402863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.406457] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.407253] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe with status ACTIVE [ 765.407506] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.407596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.407629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.408214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.408214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.408214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.408214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.408214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.408436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.408436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.410744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.410744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.410744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.410744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.410744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.410744] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe is going to be updated. [ 765.426574] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb6e69ce-aa18-43cb-be60-af4e37502a7a: rpc.has_security_group_logging(os_id): False [ 765.431043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.431043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.431043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.431345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.431397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.431554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dea5ff6b-c26b-4ba8-82ac-bb7c6ae3a5fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.454343] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.454489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.454561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.454774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.454861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.458081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.458081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.458081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.458081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.458913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.458913] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be created. [ 765.487402] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.488933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.488933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.488933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.489279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.489279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.489279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.489279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.489637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.489637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.489637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.489847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.493257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.493257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.493574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496020] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.532619] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.534201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.534201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.534201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.534201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.554159] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 765.766114] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-662 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.766573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-662" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.766573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-662" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.766846] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-662" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.767122] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.767277] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.767391] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.767600] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.767743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.768121] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.768121] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.768222] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.768258] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.768344] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.768467] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.768628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.789923] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.790512] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 765.790512] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.790512] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-662" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.790811] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.791054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.791664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.791664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.791664] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.852754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.852754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.852754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.852754] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 765.887815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.887815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.887815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.887815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.887815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.901746] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 765.911263] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.999023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa96ab4a-8a16-4875-8013-1f1b9504c258: rpc.has_security_group_logging(os_id): False [ 765.999023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 766.018057] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.018057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.018057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.021174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.021174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.021174] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.021174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.021174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.021174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.023559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.023559] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be created. [ 766.030395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.030395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.030395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.031340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.031340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.031340] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.031340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.031340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.031630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.031630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.033514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.033514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.033514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.033514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.033514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.033514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 766.118492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.118492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.119306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.119306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.119306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.122144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.122457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.122744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.122929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.123332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.136169] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 766.141714] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 766.294836] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.295238] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.295394] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.295728] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.295945] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.296139] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a not found, creating... [ 766.296426] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.296683] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.296976] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.297330] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.297497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.298068] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.298411] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.298604] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.298861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.299012] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.299238] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a is going to be created. [ 766.329323] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.329484] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.329758] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.330109] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.331066] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.331432] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.416261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.416660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.416660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.416922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.417053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.417242] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be created. [ 766.456241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.457033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.457033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.457198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.457331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.474877] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: UNINITIALIZED for 2s [ 767.087309] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-f718bde3-6c99-4445-90ff-c01cce3d78d1 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 767.087309] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-f718bde3-6c99-4445-90ff-c01cce3d78d1 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 767.087309] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-f718bde3-6c99-4445-90ff-c01cce3d78d1 service nova] Enqueued Resource ID: bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a with Priority: HIGHEST for action port [ 767.087874] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 767.087874] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 767.088049] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a with Priority: HIGHEST for action port [ 767.093441] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.093605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.093804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.094116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.094116] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.094248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.094248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.094507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.094623] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.566142] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 767.566142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.603675] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a with status ACTIVE [ 767.603675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.603675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.603675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.603675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.603675] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a is going to be updated. [ 767.623678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.623831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.623900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.624138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.624316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.624425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd60ac5d-92fa-48d1-a4d7-77547ca3dc3a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.912953] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 767.915185] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 767.915185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.151285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 768.151682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.157777] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 768.158031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.202401] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.202627] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.202748] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.203723] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.203899] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.204082] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.204366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.204472] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.204572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.204756] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.204859] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.204989] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.205119] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.205223] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.205320] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.205442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.225674] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.225674] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.225674] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.225674] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-528" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.225674] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-19758d47-0ff3-4ea3-9a80-2764086e413a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.225674] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.225674] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.226063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.226099] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19758d47-0ff3-4ea3-9a80-2764086e413a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.484322] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 768.484556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.484717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.484928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.485133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.485245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.485307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.485455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.485534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.485617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.485713] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.486534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.486889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.486889] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.487073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.487073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.487161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.487235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.487319] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.729047] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.729047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.729047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.729274] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.729311] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.729481] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 19758d47-0ff3-4ea3-9a80-2764086e413a not found, creating... [ 768.729790] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.729951] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.730080] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.730350] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.730406] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.730684] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.730826] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.730935] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.731150] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.731277] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.731409] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 19758d47-0ff3-4ea3-9a80-2764086e413a is going to be created. [ 768.766218] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.766434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.766515] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.766772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.767040] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.767276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.770455] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 768.770613] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 768.770978] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 768.771196] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 768.771339] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 768.771437] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 768.771966] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.772112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.772175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.772417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.772531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.772646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.772682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.772822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.772902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.772984] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.773750] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.773856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.773939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.774115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.774255] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.774347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.774407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.774527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.774603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.774809] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.775455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.775581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.775648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.776214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.776214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.776214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.776214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.776214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.776466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.776466] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.822207] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_rules [ 768.822379] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 768.822551] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_rules [ 768.822630] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 768.822760] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 768.822879] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 768.822995] env[65469]: INFO networking_nsxv3.common.synchronization [req-ca2b8f6d-9411-4495-9a36-a4f210caddd0 req-7ce45040-5341-4b43-84fc-1ff9859bd691 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 768.823458] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_rules [ 768.823595] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_rules [ 768.823689] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 768.823777] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea18d41-0f11-4e1a-81c1-050988de471c with Priority: HIGHEST for action port [ 768.823861] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_rules [ 768.823947] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 768.824053] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 768.824334] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.824451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.824513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.824703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.824780] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.825566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.825671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.826083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.826083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.826083] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.828353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.828493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.828763] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea18d41-0f11-4e1a-81c1-050988de471c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.828864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.828930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.829125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.830802] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea18d41-0f11-4e1a-81c1-050988de471c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.831546] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.831656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.831723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.831878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.831955] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.833060] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.833060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.833258] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.834238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.990932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.990932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.990932] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.278385] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.279495] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.280243] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.334925] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.335123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.335254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bea18d41-0f11-4e1a-81c1-050988de471c with status ACTIVE [ 769.338024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.338024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.338024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.338024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.338024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bea18d41-0f11-4e1a-81c1-050988de471c is going to be updated. [ 769.338577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.338577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.348669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.348862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.361638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.361780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.361840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.362056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.362199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.362368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea18d41-0f11-4e1a-81c1-050988de471c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.493211] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.540559] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-ad178db7-877a-490a-b83d-799f001c55a6 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 769.540710] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-ad178db7-877a-490a-b83d-799f001c55a6 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 769.540849] env[65469]: INFO networking_nsxv3.common.synchronization [req-4906b39a-6f84-4d46-8867-e84e1f97244f req-ad178db7-877a-490a-b83d-799f001c55a6 service nova] Enqueued Resource ID: 19758d47-0ff3-4ea3-9a80-2764086e413a with Priority: HIGHEST for action port [ 769.541358] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 769.541501] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 769.541627] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19758d47-0ff3-4ea3-9a80-2764086e413a with Priority: HIGHEST for action port [ 769.541891] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.541993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.542220] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.542305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.542478] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-19758d47-0ff3-4ea3-9a80-2764086e413a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.542579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.542645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.542837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.542916] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19758d47-0ff3-4ea3-9a80-2764086e413a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.782663] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.784010] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.785223] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.996084] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.996209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.996209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.996661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.996661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.996661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 770.039413] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.039561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.039561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.039871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.040201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.047360] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19758d47-0ff3-4ea3-9a80-2764086e413a with status ACTIVE [ 770.047360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.047360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.047360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.047657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.047737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.048144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.048144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.048144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.048265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.048354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.048648] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.048789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.048877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.049448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.049448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.049448] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19758d47-0ff3-4ea3-9a80-2764086e413a is going to be updated. [ 770.054308] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 770.078790] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.078790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.078790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.078790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.078790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.078790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19758d47-0ff3-4ea3-9a80-2764086e413a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.288706] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.288706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.288706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.288706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.288706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.289253] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be updated. [ 770.290903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.290903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.290903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.290903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.290903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.290903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 770.293548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.293548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.293548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.293765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.293765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.293825] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 is going to be created. [ 770.323188] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.323406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.323406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.323591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.323887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.338769] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 in Status: UNINITIALIZED for 2s [ 770.339701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.339894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.339960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.340179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.340353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.342631] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.342759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.342827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.343078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.343227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.357154] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 770.363093] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 770.456345] env[65469]: INFO networking_nsxv3.common.synchronization [req-4c0e8f12-0b90-4225-8db5-3518ad8ba743 req-7bcffaa4-e7c4-47e0-9e65-1c92fc448611 tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 770.456452] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 770.457020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.457159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.457231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.457439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.457589] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.457707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.457741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.458732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.458732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.458732] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.870043] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.870043] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.870043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.870725] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.871067] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.871279] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.871498] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.871762] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.871993] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.872214] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.872431] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.894676] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.894676] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.894676] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.894676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.894676] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.894676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.894676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.895439] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.895691] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.961719] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.398802] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.399236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.399236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.399425] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.399564] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.399721] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f not found, creating... [ 771.399979] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.400143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.400251] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.400461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.400597] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.400866] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.401110] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.401223] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.401415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.401539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.401666] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f is going to be created. [ 771.423834] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.424062] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.424181] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.424445] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.424663] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.425457] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.464780] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.734276] env[65469]: INFO networking_nsxv3.common.synchronization [None req-56751078-c26c-4368-b53e-1002dfae2886 None None] Enqueued Resource ID: 5ad94766-f58e-4d39-9f1c-380db5725186 with Priority: HIGHEST for action port [ 771.735249] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad94766-f58e-4d39-9f1c-380db5725186 with Priority: HIGHEST for action port [ 771.735577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ad94766-f58e-4d39-9f1c-380db5725186 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.735704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ad94766-f58e-4d39-9f1c-380db5725186" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.735771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ad94766-f58e-4d39-9f1c-380db5725186" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.736054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ad94766-f58e-4d39-9f1c-380db5725186" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.736141] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ad94766-f58e-4d39-9f1c-380db5725186',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.967494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.967739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.967868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.968048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.968142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.968272] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 772.014779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.015397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.015397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.015397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.015637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.026664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 772.066631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 772.066963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.067183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.067403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.067609] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.067921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.068031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.070086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.070086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.070086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.070086] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.072763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.073084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.073253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.073358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.073418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.073560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.074291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.074291] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.207316] env[65469]: INFO networking_nsxv3.common.synchronization [req-4c0e8f12-0b90-4225-8db5-3518ad8ba743 req-1ea00023-7a86-438a-9c87-8cff8121edf8 service nova] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_rules [ 772.207486] env[65469]: INFO networking_nsxv3.common.synchronization [req-4c0e8f12-0b90-4225-8db5-3518ad8ba743 req-1ea00023-7a86-438a-9c87-8cff8121edf8 service nova] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 772.207616] env[65469]: INFO networking_nsxv3.common.synchronization [req-4c0e8f12-0b90-4225-8db5-3518ad8ba743 req-1ea00023-7a86-438a-9c87-8cff8121edf8 service nova] Enqueued Resource ID: 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f with Priority: HIGHEST for action port [ 772.208254] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_rules [ 772.208394] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 772.208490] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f with Priority: HIGHEST for action port [ 772.208987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.209192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.209257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.209464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.209539] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.210536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.210639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.210813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.210917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.211990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.211990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.211990] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.238215] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ad94766-f58e-4d39-9f1c-380db5725186 [ 772.238941] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.238941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.238941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.239285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.239285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.239285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ad94766-f58e-4d39-9f1c-380db5725186 already deleted. [ 772.239285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ad94766-f58e-4d39-9f1c-380db5725186" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.352627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 in Status: SUCCESS [ 772.352847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.353520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.354132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.354132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.355514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.355514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.355514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.355514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.355514] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.368019] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.368019] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.368019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.368389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.368577] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.370749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 772.371657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.372093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.372281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.372449] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.372555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.372630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.372786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.375488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.375488] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.573067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d3a53e0-bc08-4699-b179-a2a446524a23: rpc.has_security_group_logging(os_id): False [ 772.576792] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.594347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.594347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.594502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.594599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.594689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.594889] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.594984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.595055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.595201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.595279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.595455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.595545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.595604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.595740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.595894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.599277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.599277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.599277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.599277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599277] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be created. [ 772.648521] env[65469]: INFO networking_nsxv3.common.synchronization [req-fd9730d8-f607-483b-9f7b-c20af5050c32 req-a4678692-fa33-46f5-843d-4bb69014072b tempest-ServerAddressesTestJSON-407503602 tempest-ServerAddressesTestJSON-407503602-project-member] Enqueued Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 772.649107] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 772.649421] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.653044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.653132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.653398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.653574] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.653683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.653743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.653902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.653988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.654103] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.661937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.662094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.662145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.662348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.662525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.676851] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 772.712793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.712892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.714337] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f with status ACTIVE [ 772.714549] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.714914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.714914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.715260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.715260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.715494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.715551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.715589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.715806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.715890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.716115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.716217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.716317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.717276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.717402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.717458] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f is going to be updated. [ 772.741760] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.741947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.742050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.742684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.742684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.742684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1908ab9f-e0a1-4f4c-8238-6260f4f2ac8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.857044] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.875807] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.881458] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.012064] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.012064] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-481" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.012064] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-481" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012064] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-481" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012307] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.012307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.012396] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012763] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.012967] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.015130] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.015296] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.015415] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.015533] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.015639] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.015770] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.043098] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.043098] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.043098] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.043098] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-481" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.043098] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a6c4be7d-4613-4784-aa4d-16005e1ad45b taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.043098] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.043098] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.043466] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.043466] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6c4be7d-4613-4784-aa4d-16005e1ad45b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.082517] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.156322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.156492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.156593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.156788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.156890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.157069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.157194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.157236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.157366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.157443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.157528] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 already deleted. [ 773.157601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.359369] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.381853] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.384378] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.546505] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.547159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.547159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.547159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.547301] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.547412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a6c4be7d-4613-4784-aa4d-16005e1ad45b not found, creating... [ 773.547665] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.547814] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.547925] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.548150] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.548280] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.551022] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.551022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.551022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.551022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.551022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.551022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a6c4be7d-4613-4784-aa4d-16005e1ad45b is going to be created. [ 773.573456] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.573890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.573890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.574026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.575364] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.575364] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.585216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.585450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.585450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.585643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.585794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.585918] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 773.637541] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.637703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.637750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.637970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.638132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.651365] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 773.861838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.862013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.862091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.862298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.862387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.862490] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 is going to be updated. [ 773.884400] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.884541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.884621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.884832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.884917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.885029] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be updated. [ 773.886317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.886435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.886506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.886671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.886753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.886841] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 773.896578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.896755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.896851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.897064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.897212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.905366] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 in Status: IN_PROGRESS for 2s [ 773.916650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.916821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.916925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.917825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.917825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.918971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.919253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.919349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.919568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.919711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.930491] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 773.931464] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 774.033790] env[65469]: INFO networking_nsxv3.common.synchronization [None req-207bbdc9-771c-4a94-ac83-5abe65c8538d None None] Enqueued Resource ID: 61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1 with Priority: HIGHEST for action port [ 774.034417] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1 with Priority: HIGHEST for action port [ 774.034743] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.034862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.034928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.035788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.036015] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.039363] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 774.039497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.040078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.040321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.040604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.040799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.040963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.041194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.041409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.041575] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.383739] env[65469]: INFO networking_nsxv3.common.synchronization [req-fd9730d8-f607-483b-9f7b-c20af5050c32 req-c8ab2eb9-ba59-4e37-86e2-b695dafad691 service nova] Enqueued Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_rules [ 774.383739] env[65469]: INFO networking_nsxv3.common.synchronization [req-fd9730d8-f607-483b-9f7b-c20af5050c32 req-c8ab2eb9-ba59-4e37-86e2-b695dafad691 service nova] Enqueued Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 774.383866] env[65469]: INFO networking_nsxv3.common.synchronization [req-fd9730d8-f607-483b-9f7b-c20af5050c32 req-c8ab2eb9-ba59-4e37-86e2-b695dafad691 service nova] Enqueued Resource ID: a6c4be7d-4613-4784-aa4d-16005e1ad45b with Priority: HIGHEST for action port [ 774.384427] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_rules [ 774.384582] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 774.384872] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6c4be7d-4613-4784-aa4d-16005e1ad45b with Priority: HIGHEST for action port [ 774.385655] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.385826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.385951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.386691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.386828] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.391635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.391635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.391635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.391635] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.391635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6c4be7d-4613-4784-aa4d-16005e1ad45b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.392309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.392309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.392309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.392309] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6c4be7d-4613-4784-aa4d-16005e1ad45b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.543335] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.544511] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1 [ 774.544511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.544633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.544709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.545371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.545371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.545371] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1 already deleted. [ 774.545371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61884ed9-4fb8-42ce-a8c2-a3ed6a3e68f1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.693155] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 774.693411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.693576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.693786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.693901] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.894150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.894345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.894554] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.897238] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6c4be7d-4613-4784-aa4d-16005e1ad45b with status ACTIVE [ 774.897440] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.897564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.897924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.897924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.898139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.898139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.898250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.898312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.898561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.898561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.898781] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.898883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.898952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.899138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.899215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.899301] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6c4be7d-4613-4784-aa4d-16005e1ad45b is going to be updated. [ 774.922032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.922174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.922278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.922480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.922632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.922828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6c4be7d-4613-4784-aa4d-16005e1ad45b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.026476] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:0 completed [ 775.028052] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:1 started [ 775.047814] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.380594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.380594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.400246] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.551039] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.551548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.551548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.552047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.552182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.552348] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 775.587350] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.587591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.587591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.588845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.588845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.601820] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 775.662141] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 775.664033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.664033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.664033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.664033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.664268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.664268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.664351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.664458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.664544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.664636] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.754149] env[65469]: INFO networking_nsxv3.common.synchronization [req-6aa590bc-4ac7-4752-a633-acdc0748a580 req-1b7afd49-8d89-4c95-afdf-27fad88a8132 tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 775.754786] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 775.755637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.755637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.755637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.755637] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.757586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.757933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.758082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.758343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.758439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.758545] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.900516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.904595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.904595] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 is going to be created. [ 775.917596] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 in Status: SUCCESS [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.920071] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.920071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.920071] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.944196] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 775.944408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.944903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.946024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.946024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.946024] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.947557] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.947665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.947730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.947885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.948054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.949659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 775.950651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.950651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.950651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.950651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.950829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.950829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.950961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.951133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.951133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.951231] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.961819] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: UNINITIALIZED for 2s [ 776.167530] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.167778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.167851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.168475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.168475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.168475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.168475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.168902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.168902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.168902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.169084] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.169168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.169219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.169428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.169627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.169900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.169900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.170026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.170341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.170504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.170578] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.214661] env[65469]: INFO networking_nsxv3.common.synchronization [req-a3dfe569-891a-4978-a47f-cc8d8bdf2f4d req-a31be94c-856e-4304-9ed6-6458a6f5dd31 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 776.215719] env[65469]: INFO networking_nsxv3.common.synchronization [req-a3dfe569-891a-4978-a47f-cc8d8bdf2f4d req-a31be94c-856e-4304-9ed6-6458a6f5dd31 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 776.215905] env[65469]: INFO networking_nsxv3.common.synchronization [req-a3dfe569-891a-4978-a47f-cc8d8bdf2f4d req-a31be94c-856e-4304-9ed6-6458a6f5dd31 tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 776.217135] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 with Priority: HIGHEST for action security_group_members [ 776.217326] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 with Priority: HIGHEST for action security_group_members [ 776.217401] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 776.217673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.217797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.217871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.218089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.218272] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.218396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.218396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.218545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.218672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.218752] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.219668] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa96ab4a-8a16-4875-8013-1f1b9504c258 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.219824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.219914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.220144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.220351] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.220462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.220518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.220671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.220758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.220849] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.221690] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.221793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.221863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.222026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.222166] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.222258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.222320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.222449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.222525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.222613] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.261829] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.423637] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.453620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.454048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.455753] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa96ab4a-8a16-4875-8013-1f1b9504c258',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.483368] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.483615] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.483779] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.484069] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.484360] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.484557] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.484700] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.484950] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.485154] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.485427] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.485930] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.486074] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.486241] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.486330] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.486480] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.486624] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.508545] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.509165] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.509165] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.509502] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.510210] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-f797ed27-6b50-449b-b6d5-1aaf42024c58 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.510365] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.510484] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.510829] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.510986] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f797ed27-6b50-449b-b6d5-1aaf42024c58',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.673704] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d3a53e0-bc08-4699-b179-a2a446524a23: rpc.has_security_group_logging(os_id): False [ 776.692862] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.693024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.693097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.693310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.693405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.693761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.693761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.693872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.693998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.694089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.694279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.694384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.694445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.694658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.694740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.695114] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.695226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.695266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.695433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.695513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.695599] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 776.724877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.725165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.725282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.725579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.725732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.726063] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.726256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.726321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.726574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.726710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.727268] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 is going to be deleted. [ 776.728209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.728323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.728389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.728550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.728635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.728834] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.728933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.729033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.729222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.729311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.729410] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be updated. [ 776.730393] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.764226] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.769782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.769996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.770107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.770325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.770472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.783131] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.783410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.783410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.783647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.783763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.783848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.786606] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 776.802171] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.802433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.802496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.802784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.802942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.816484] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 776.928223] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756: rpc.has_security_group_logging(os_id): False [ 776.954360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.955224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.955224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.955224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.955224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.955224] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.955514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.955514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.955514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.955629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.955724] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 is going to be created. [ 776.960304] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa96ab4a-8a16-4875-8013-1f1b9504c258: rpc.has_security_group_logging(os_id): False [ 776.981695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.981916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.981916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.982171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.982267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.982674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.982787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.982867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.983096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.983186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.983277] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 is going to be updated. [ 776.986427] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756], does not exist path=[/infra/domains/default/groups/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756]."\n}' [ 776.986767] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 [ 776.986852] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 777.013816] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.014070] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.014180] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.014481] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.014676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.014869] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port f797ed27-6b50-449b-b6d5-1aaf42024c58 not found, creating... [ 777.015244] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.015455] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.015583] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.015879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.016082] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.016408] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.016595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.016742] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.017216] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.017290] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.017484] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: f797ed27-6b50-449b-b6d5-1aaf42024c58 is going to be created. [ 777.054125] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.054662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.058293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.058293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.058293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.058293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.063749] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.063918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.063961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.064339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.065701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.066038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.066146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.066229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.066412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.066491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.066854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.066981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.067049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.067216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.067335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.067385] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 is going to be created. [ 777.069665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.069813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.069949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.070171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.070329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.086870] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: IN_PROGRESS for 2s [ 777.089023] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756], does not exist path=[/infra/domains/default/groups/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 [ 777.089023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.089754] env[65469]: Traceback (most recent call last): [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 777.089754] env[65469]: return func(*args, **kwargs) [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.089754] env[65469]: res.raise_for_status() [ 777.089754] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.089754] env[65469]: raise HTTPError(http_error_msg, response=self) [ 777.089754] env[65469]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 [ 777.089754] env[65469]: During handling of the above exception, another exception occurred: [ 777.089754] env[65469]: Traceback (most recent call last): [ 777.089754] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 777.089754] env[65469]: listener.cb(fileno) [ 777.089754] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 777.089754] env[65469]: result = function(*args, **kwargs) [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 777.089754] env[65469]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 777.089754] env[65469]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 777.089754] env[65469]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 777.089754] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.089754] env[65469]: res.raise_for_status() [ 777.089754] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.089754] env[65469]: raise HTTPError(http_error_msg, response=self) [ 777.089754] env[65469]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b8cc39f4-dfae-4ed4-9d3e-c8cab1dc3756 [ 777.089754] env[65469]: Removing descriptor: 24 [ 777.233412] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.267869] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.268105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.268149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.268377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.268482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.268592] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 777.328440] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.328621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.328728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.328971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.329161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.342979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 777.614424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 777.614558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.614751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.614975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.615181] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.615305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.615370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.615571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.615682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.615776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.616147] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.736476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.736798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.736798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.737077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.737155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.737275] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 777.774982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.775407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.775407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.775661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.775661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.789788] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 777.817958] env[65469]: INFO networking_nsxv3.common.synchronization [req-6aa590bc-4ac7-4752-a633-acdc0748a580 req-19063224-bf7e-44c2-aa70-c906512730e8 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 777.817958] env[65469]: INFO networking_nsxv3.common.synchronization [req-6aa590bc-4ac7-4752-a633-acdc0748a580 req-19063224-bf7e-44c2-aa70-c906512730e8 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 777.817958] env[65469]: INFO networking_nsxv3.common.synchronization [req-6aa590bc-4ac7-4752-a633-acdc0748a580 req-19063224-bf7e-44c2-aa70-c906512730e8 service nova] Enqueued Resource ID: f797ed27-6b50-449b-b6d5-1aaf42024c58 with Priority: HIGHEST for action port [ 777.818493] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 777.818493] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 777.818618] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f797ed27-6b50-449b-b6d5-1aaf42024c58 with Priority: HIGHEST for action port [ 777.820996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.820996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.820996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.820996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.820996] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.820996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.820996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.820996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f797ed27-6b50-449b-b6d5-1aaf42024c58 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.821368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.821368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.821501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.821657] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f797ed27-6b50-449b-b6d5-1aaf42024c58',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.972558] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: SUCCESS [ 777.972875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.973210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.973284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.973469] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.973589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.973650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.973803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.973883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.973968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.974070] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.000090] env[65469]: INFO networking_nsxv3.common.synchronization [req-2944e6d8-47cf-4e4f-8bd2-2b3e636c26bc req-723fd0c3-ca4f-478c-924d-424fa2669f18 tempest-ServerMetadataNegativeTestJSON-1900175863 tempest-ServerMetadataNegativeTestJSON-1900175863-project-member] Enqueued Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 778.000961] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGHEST for action security_group_members [ 778.001393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.001558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.001675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.001950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.002170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.002332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.002483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.002662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.002776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.003146] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.124282] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.124529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.124649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.125041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.125277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.125499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.125499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.125813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.125813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.125961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.126196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.126373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.126373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.126619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.126911] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.127120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.127120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.127276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.127352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.127421] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.127487] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.326028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.326028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f797ed27-6b50-449b-b6d5-1aaf42024c58 with status ACTIVE [ 778.326028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.326028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.326028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.326028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.326786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.326786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.326786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.326786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.326786] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f797ed27-6b50-449b-b6d5-1aaf42024c58 is going to be updated. [ 778.366521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.366773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.366773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.367012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.367145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.367318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f797ed27-6b50-449b-b6d5-1aaf42024c58" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.415122] env[65469]: INFO networking_nsxv3.common.synchronization [req-9ff6fb6d-993f-466c-95c6-3b3e1d3e6e11 req-684e66cf-9ae0-474a-8397-4d6e30167f97 tempest-ServersTestManualDisk-885771844 tempest-ServersTestManualDisk-885771844-project-member] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 778.415954] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGHEST for action security_group_members [ 778.416514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.416514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.416848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.417100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.417448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.417448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.417847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.418257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.418456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.418515] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.477590] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.477775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.477858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.478050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.478539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.478539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.478539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.478539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.478773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.478773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.480154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.480154] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.505643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.505890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.505994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.506239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.528472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.528738] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.528883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.529305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.529305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.529305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.529447] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31117731-2c40-474a-b432-88e9d4361256 is going to be updated. [ 778.571445] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.571665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.571743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.572142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.572142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.583225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: IN_PROGRESS for 2s [ 778.630055] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1934be84-8ae3-4bd7-9b51-c38b417cac45: rpc.has_security_group_logging(os_id): False [ 778.651773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.651773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.651773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.651773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.673895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.674253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.674433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.674502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.674700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.674784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.674963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.675076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.675140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.675288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.675361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.675532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.675624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.675702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.675811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.675883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.675965] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 778.740952] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.741152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.741256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.741433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.741582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.754368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 778.802031] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 778.802439] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 deletion is rescheduled due to dependency. [ 778.802439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.837047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 778.837326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.837630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.837936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.838052] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.921573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.921873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.921948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.922221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.945861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.946130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.946249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.946307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.946515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.946586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.946709] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c is going to be updated. [ 778.975161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.975161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.975161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.975376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.975446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.982171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a364140-b1e3-425b-b89e-3ba5be093853: rpc.has_security_group_logging(os_id): False [ 778.988828] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: IN_PROGRESS for 2s [ 778.999970] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.000165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.000165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.000479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.000581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.000808] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.000941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.001021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.001206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.001320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.001479] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.001576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.001636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.001778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.001855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.002047] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.002260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.002260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.002364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.002440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.002543] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 is going to be created. [ 779.078479] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.078725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.078976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.079072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.079294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.092205] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: IN_PROGRESS for 2s [ 779.109739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa96ab4a-8a16-4875-8013-1f1b9504c258 in Status: SUCCESS [ 779.109739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa96ab4a-8a16-4875-8013-1f1b9504c258" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.341243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.341479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.341610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.341928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.342212] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.342497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.342497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.342727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.342863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.343012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.343166] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.369213] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 779.369213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.369213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.369540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.369540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.369692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.369760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.369945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.370044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.370901] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.807057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 779.807057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.807057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.807057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.807057] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.807561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.807561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.807561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.807561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.807692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.807800] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.807899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.807956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.808267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.808459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.808603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.808725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.808893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.808992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.809156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.809320] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.853024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.853024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.853024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.853024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.853024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.853768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.853768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.853768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.853768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.853768] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.876495] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.312915] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 780.335314] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.335464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.335686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.336612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.355923] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d3a53e0-bc08-4699-b179-a2a446524a23: rpc.has_security_group_logging(os_id): False [ 780.364204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.364204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.364450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.364450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.364522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.364612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.364807] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.364891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.364937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.365103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.365178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.365366] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.365505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.365505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.365710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.365710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.365832] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 780.381556] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.396521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.396798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.396798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.397396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.430793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.431229] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.431229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.431528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.431528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.431596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.431787] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.431921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.431981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.432149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.432248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.432470] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.432517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.432591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.432718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.432789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.432877] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 780.469829] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.470037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.470088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.470277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.470425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.499838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 780.554674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.555727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.555727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.555894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.556304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.580835] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 780.597070] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31117731-2c40-474a-b432-88e9d4361256 in Status: SUCCESS [ 780.597070] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31117731-2c40-474a-b432-88e9d4361256 deletion is rescheduled due to dependency. [ 780.597070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.768817] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 780.769151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.884597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.884893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.884893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.885091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.885177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.885274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 780.918248] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.918392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.918463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.918752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.918921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.930990] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 781.006278] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c in Status: SUCCESS [ 781.006278] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c deletion is rescheduled due to dependency. [ 781.006456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.111818] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: SUCCESS [ 781.112744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.501392] env[65469]: INFO networking_nsxv3.common.synchronization [req-e7d668f4-0cca-42ab-985d-cef9450d1b04 req-f65bce21-a66a-4194-b089-830e48f72c93 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 781.502951] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 781.503419] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.507024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.507024] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.007910] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.009702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.009702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.009702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.038652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.039160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.039321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.039396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.039647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.039734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.039833] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be updated. [ 782.075631] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.075862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.075862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.076133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.076275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.090266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: IN_PROGRESS for 2s [ 782.518722] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 782.518722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.597298] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 782.597797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.949084] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 782.949084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.949084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.949084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.949447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.949527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.949718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.950741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.950741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.950741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.950741] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.454404] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.455755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.455945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.456567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.456939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.457156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.457289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.457580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.457750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.457921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.458205] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.458379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.458488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.458681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.458924] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.459069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.459151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.459256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.459333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.459413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.459545] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.936805] env[65469]: INFO networking_nsxv3.common.synchronization [None req-33169108-71e9-44fe-8992-cc399ce9406d None None] Enqueued Resource ID: 9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f with Priority: HIGHEST for action port [ 783.939503] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f with Priority: HIGHEST for action port [ 783.939843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.939964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.940040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.940315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.940396] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.962582] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb6e69ce-aa18-43cb-be60-af4e37502a7a: rpc.has_security_group_logging(os_id): False [ 783.982922] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.983150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.983357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.983422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.004089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.004347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.004833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.004833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.004833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.004833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.005018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.005124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.005180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.005379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.005455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.005624] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.005709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.006021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.006021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.006021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.006248] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 784.076773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.076932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.077025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.077255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.077422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.094544] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 784.099615] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 784.099745] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 deletion is rescheduled due to dependency. [ 784.100020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.445417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f [ 784.446030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.446030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.446030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.446200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.446200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.446295] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f already deleted. [ 784.446361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e4d355b-0cc5-4f59-9c7d-38f6f290dd8f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.469670] env[65469]: INFO networking_nsxv3.common.synchronization [req-69de3bd8-4f3b-4548-bad7-d8338c847df8 req-50175952-1c3a-48ea-97f8-c7fbc0c8ed8f tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 784.470592] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 784.471296] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.471296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.471296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.471471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.471610] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.471732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.471795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.471965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.472088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.472199] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.705372] env[65469]: INFO networking_nsxv3.common.synchronization [req-69de3bd8-4f3b-4548-bad7-d8338c847df8 req-1c77cf41-21c5-44c0-a3cf-4ef448edd1b7 tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 784.705372] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 784.705372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.705372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.973886] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.013431] env[65469]: INFO networking_nsxv3.common.synchronization [req-69de3bd8-4f3b-4548-bad7-d8338c847df8 req-ec739e51-02e6-44a5-89cf-6e430c83da7e tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 785.013723] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 785.014159] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.014300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.476928] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.951840] env[65469]: INFO networking_nsxv3.common.synchronization [req-c6f0a081-004b-4da0-bb9a-a704c2cbf694 req-a525480b-d52a-4ef5-85a1-4e613ca4cea7 tempest-ServerGroupTestJSON-693151133 tempest-ServerGroupTestJSON-693151133-project-member] Enqueued Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 785.951840] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 785.951840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.952870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.953862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.954029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.954271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.954441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.954610] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.983662] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.983662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.983662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.983662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.983662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.983662] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 786.018201] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.018201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.018201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.018201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.018201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.028286] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 786.120329] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 786.120329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.404910] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-804 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.405127] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-804" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.405251] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-804" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.405579] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-804" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.405854] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.406324] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.406470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.406700] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.406969] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.407205] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.407316] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.407419] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.407519] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.407624] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.407726] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.407849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.428508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.428683] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.428854] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.429066] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-804" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.429424] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.429587] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.429702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.430045] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.430185] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa34bd4-a02d-4aab-acc2-18b1a8f792aa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.456846] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.457030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.457105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.457459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.457459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.457742] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.457742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.458418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.458635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.458867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.458867] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 already deleted. [ 786.459022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.934523] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.934523] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.934523] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.934523] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.934523] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.934523] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa not found, creating... [ 786.934969] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.934969] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.934969] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.935138] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.935279] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.936054] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.936054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.936054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.936054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.936473] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.936473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa is going to be created. [ 786.967727] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.968564] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.968767] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.969456] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.969456] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.969635] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.689671] env[65469]: INFO networking_nsxv3.common.synchronization [req-c6f0a081-004b-4da0-bb9a-a704c2cbf694 req-d8cea31b-59c9-4cfd-8436-9a04bdd78a15 service nova] Enqueued Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_rules [ 787.689889] env[65469]: INFO networking_nsxv3.common.synchronization [req-c6f0a081-004b-4da0-bb9a-a704c2cbf694 req-d8cea31b-59c9-4cfd-8436-9a04bdd78a15 service nova] Enqueued Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 787.690069] env[65469]: INFO networking_nsxv3.common.synchronization [req-c6f0a081-004b-4da0-bb9a-a704c2cbf694 req-d8cea31b-59c9-4cfd-8436-9a04bdd78a15 service nova] Enqueued Resource ID: 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa with Priority: HIGHEST for action port [ 787.690804] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_rules [ 787.690965] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 787.691229] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa with Priority: HIGHEST for action port [ 787.692699] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.692871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.693267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.693638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.693739] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.694929] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.695092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.695157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.695335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.695523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.695635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.695681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.695840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.695937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.696899] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.697078] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.697078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.697179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.697320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.697420] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa34bd4-a02d-4aab-acc2-18b1a8f792aa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.038151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 788.038426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.038841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.039074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.039215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.039256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.039413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.039499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039623] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.200563] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.202108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202108] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa with status ACTIVE [ 788.202451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202881] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.203104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.203238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.204022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.204022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.204022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.204022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.204022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.204022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.204022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2aa34bd4-a02d-4aab-acc2-18b1a8f792aa is going to be updated. [ 788.226791] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.226944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.227022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.227259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.227419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.227579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa34bd4-a02d-4aab-acc2-18b1a8f792aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.543855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.544044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.544161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.544308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.544395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.544590] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.544685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.544750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.545012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.545146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.545280] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 788.581494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.581655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.581697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.581901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.582380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.592094] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 788.706726] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.209935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.210396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.210396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.210508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.210508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.210620] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 is going to be created. [ 789.236583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.236835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.236885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.237170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.237400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.250134] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: UNINITIALIZED for 2s [ 789.597442] env[65469]: INFO networking_nsxv3.common.synchronization [req-d2da1b77-d9f3-422d-8c5a-86afe04c62c7 req-53921f91-6f42-4154-a897-be680437580e tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 789.598099] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 789.598531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.598715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.598840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.599107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.599316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.599477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.599572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.599775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.599931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.600068] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [req-d2da1b77-d9f3-422d-8c5a-86afe04c62c7 req-53921f91-6f42-4154-a897-be680437580e tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [req-d2da1b77-d9f3-422d-8c5a-86afe04c62c7 req-53921f91-6f42-4154-a897-be680437580e tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [req-d2da1b77-d9f3-422d-8c5a-86afe04c62c7 req-53921f91-6f42-4154-a897-be680437580e tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 789.624794] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 789.625013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.625169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.625288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.625528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.625648] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.626641] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.627269] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-18f90b1a-d6d8-4afb-b641-f7d089899e3f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.627435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.629625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.629625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.629625] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f90b1a-d6d8-4afb-b641-f7d089899e3f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.924650] env[65469]: INFO networking_nsxv3.common.synchronization [req-6000e6b6-7c16-47d8-a891-2c2bb3ff5101 req-a2d8c43a-1bac-43a7-8cd7-5d1ed1498b0b tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 789.925388] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 789.925548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.925854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.925926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.926140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.926297] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.926402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.926461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.926607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.926691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.926798] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.102810] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.130212] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.130212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.130375] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18f90b1a-d6d8-4afb-b641-f7d089899e3f with status ACTIVE [ 790.130544] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.130658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.130752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.130926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.131217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.131317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.131377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.131537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.131790] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.131897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.131961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.134442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.134442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.134540] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f is going to be updated. [ 790.160189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.160381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.160452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.160729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.161392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.161392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.312429] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.312746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.312746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.313009] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.313271] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.313422] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.313591] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.313868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.314407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.314825] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.315108] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.315407] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.315721] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.316014] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.316296] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.316619] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.353771] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.354037] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.354237] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.354441] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.354766] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-e194c47d-a8a7-4a1c-913b-65717e0cd62a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.354943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.355074] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.355426] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.355561] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e194c47d-a8a7-4a1c-913b-65717e0cd62a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.431013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.431291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.431360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.431582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.456992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.457281] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.457419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.457482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.457670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.457770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.457839] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 790.493346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.493346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.493461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.493569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.493708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.504054] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 790.564344] env[65469]: INFO networking_nsxv3.common.synchronization [req-b62eee7b-7f38-4a18-ad9a-b4e286f72077 req-f332d8b1-5818-4dd7-8ea9-f511a9c466dd tempest-ServerAddressesTestJSON-407503602 tempest-ServerAddressesTestJSON-407503602-project-member] Enqueued Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 790.565054] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGHEST for action security_group_members [ 790.565054] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.565209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.565209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.565353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.565516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.566268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.566268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.566268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.566268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.566268] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.604564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 790.604750] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 deletion is rescheduled due to dependency. [ 790.604848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.605090] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.606038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.606169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.606355] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.606473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.606538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.606706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.606800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.607140] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.860089] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.860331] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.863015] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port e194c47d-a8a7-4a1c-913b-65717e0cd62a not found, creating... [ 790.863015] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.863015] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.863015] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.863520] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.863520] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.863520] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.863520] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.863520] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: e194c47d-a8a7-4a1c-913b-65717e0cd62a is going to be created. [ 790.883409] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.883693] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.883821] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.884111] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.884398] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.884886] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.068949] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.069129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.069193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.069408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.069499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.069720] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.069845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.069903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.070068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.070164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.070230] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 is going to be updated. [ 791.108718] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.108718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.108718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.111099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.111099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.111099] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be updated. [ 791.111099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.111099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.111099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.111521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.111521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.111521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.111521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.111521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.111680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.111714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.111916] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 791.129544] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.129757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.129757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.130108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.130280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.142702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: IN_PROGRESS for 2s [ 791.155116] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.155116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.155116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.155116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.155116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.157947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.157947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.157947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.157947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.157947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.174498] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: IN_PROGRESS for 2s [ 791.178077] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 791.264356] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: SUCCESS [ 791.264818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.264917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.265262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.265510] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.265652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.265751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.265938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.266071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.266170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.267237] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.592935] env[65469]: INFO networking_nsxv3.common.synchronization [req-6000e6b6-7c16-47d8-a891-2c2bb3ff5101 req-f27ee546-a403-401c-a2a8-0600d5e0a74b service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 791.593248] env[65469]: INFO networking_nsxv3.common.synchronization [req-6000e6b6-7c16-47d8-a891-2c2bb3ff5101 req-f27ee546-a403-401c-a2a8-0600d5e0a74b service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 791.593366] env[65469]: INFO networking_nsxv3.common.synchronization [req-6000e6b6-7c16-47d8-a891-2c2bb3ff5101 req-f27ee546-a403-401c-a2a8-0600d5e0a74b service nova] Enqueued Resource ID: e194c47d-a8a7-4a1c-913b-65717e0cd62a with Priority: HIGHEST for action port [ 791.593849] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 791.594017] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 791.594754] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e194c47d-a8a7-4a1c-913b-65717e0cd62a with Priority: HIGHEST for action port [ 791.599108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.599108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.599108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.599108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.599108] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.599484] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.599580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.599836] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e194c47d-a8a7-4a1c-913b-65717e0cd62a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.599943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.600009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.600186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.600257] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e194c47d-a8a7-4a1c-913b-65717e0cd62a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.772451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.772808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.772986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.773294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.773985] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.774314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.774542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.774862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.775117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.775334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.775640] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.775972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.776173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.776454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.776741] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.777159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.777340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.777617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.777841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.778210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.778422] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.103757] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.103757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.104369] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e194c47d-a8a7-4a1c-913b-65717e0cd62a with status ACTIVE [ 792.104369] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.104369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.104369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.105279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.105279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.105279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.105279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.105279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.105517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.105517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.105585] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.105740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.105740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.109471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.109471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.109471] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e194c47d-a8a7-4a1c-913b-65717e0cd62a is going to be updated. [ 792.140222] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.140424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.140819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.140819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.140937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.141196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e194c47d-a8a7-4a1c-913b-65717e0cd62a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.282946] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab3db8e0-1f52-4d95-9b58-4be9adf31de9: rpc.has_security_group_logging(os_id): False [ 792.320980] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.321351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.321351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.324534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.324534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.324534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.324534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.325267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.325267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.325267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.325267] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 is going to be created. [ 792.386686] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.386863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.386937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.387163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.387538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.401497] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: IN_PROGRESS for 2s [ 792.517392] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 792.517392] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 792.517392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.517392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.517392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.517392] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.517943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.518266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.518704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.518992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.519307] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.023635] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.154345] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a364140-b1e3-425b-b89e-3ba5be093853 in Status: SUCCESS [ 793.154695] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 deletion is rescheduled due to dependency. [ 793.154895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.186052] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 793.186353] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 deletion is rescheduled due to dependency. [ 793.186539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.187490] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 793.187710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.187997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.188298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.188969] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.189145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.189274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.189487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.189638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.189769] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.318116] env[65469]: INFO networking_nsxv3.common.synchronization [req-abc4c952-b8eb-4851-876d-2c670d2d129a req-5de50d26-3260-4656-b64f-ec059b9b22a5 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 793.319513] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 793.319913] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.320039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.334157] env[65469]: INFO networking_nsxv3.common.synchronization [req-abc4c952-b8eb-4851-876d-2c670d2d129a req-5de50d26-3260-4656-b64f-ec059b9b22a5 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 793.334324] env[65469]: INFO networking_nsxv3.common.synchronization [req-abc4c952-b8eb-4851-876d-2c670d2d129a req-5de50d26-3260-4656-b64f-ec059b9b22a5 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 793.334452] env[65469]: INFO networking_nsxv3.common.synchronization [req-abc4c952-b8eb-4851-876d-2c670d2d129a req-5de50d26-3260-4656-b64f-ec059b9b22a5 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 793.334980] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_rules [ 793.335134] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 793.335234] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f with Priority: HIGHEST for action port [ 793.335508] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.335606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.335787] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.335866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.336048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-18f90b1a-d6d8-4afb-b641-f7d089899e3f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.336154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.336213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.336457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.336505] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f90b1a-d6d8-4afb-b641-f7d089899e3f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.526990] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.692678] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.841459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18f90b1a-d6d8-4afb-b641-f7d089899e3f with status ACTIVE [ 793.841459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.841459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.841459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.841459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.841459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18f90b1a-d6d8-4afb-b641-f7d089899e3f is going to be updated. [ 793.867547] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.867783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.867882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.868096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.868246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.868417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18f90b1a-d6d8-4afb-b641-f7d089899e3f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.029295] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.029632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.029632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.029782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.029862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.029984] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 794.067101] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.067490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.067490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.069426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.069426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.079950] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 794.196953] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.420352] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: SUCCESS [ 794.420548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.699300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.699622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.699622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.699751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.699916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.700091] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be updated. [ 794.732292] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.732661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.732661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.732925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.733199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.743825] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: IN_PROGRESS for 2s [ 796.093432] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 796.093781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.093863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.094119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.094320] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.094443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.094509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.094669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.094750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.094830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.094922] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.597660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.600340] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.600340] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.600340] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.600340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.601316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.601316] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.754134] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 796.754134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.754274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.754692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.754763] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.754871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.754923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.755091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.755173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.755258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.755352] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.757162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.758139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.758139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.758139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.758139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.758139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.758139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.758139] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.102719] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 797.129370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.129370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.129370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.134199] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.134199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.134199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.134350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.134350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.134659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 797.215038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.215225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.215291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.215716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.216566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.236878] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 797.260702] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.262139] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.764157] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65: rpc.has_security_group_logging(os_id): False [ 797.765512] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.792976] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.793243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.793243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.793499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.816548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.817050] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.817261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.817376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.817703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.817868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.818043] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be updated. [ 797.921957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.922235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.922235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.922486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.922780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.947869] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: IN_PROGRESS for 2s [ 798.182232] env[65469]: INFO networking_nsxv3.common.synchronization [req-d1336c55-f76b-49f8-9939-f510048013b3 req-fa87118a-ebbd-481d-a6bb-79e313ddbfb9 tempest-AttachInterfacesUnderV243Test-412668467 tempest-AttachInterfacesUnderV243Test-412668467-project-member] Enqueued Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 798.182814] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 with Priority: HIGHEST for action security_group_members [ 798.183178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.183329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.270418] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.270605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.270684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.270939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.271046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.271140] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be updated. [ 798.331786] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.331786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.331786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.332105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.332293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.341545] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: IN_PROGRESS for 2s [ 799.252802] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 799.253212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.330275] env[65469]: INFO networking_nsxv3.common.synchronization [req-cad890a1-7e9e-4684-8934-eccc8a4a4e07 req-72739db7-bdca-4203-8f99-4092ffd74269 tempest-ServerGroupTestJSON-693151133 tempest-ServerGroupTestJSON-693151133-project-member] Enqueued Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 799.330808] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGHEST for action security_group_members [ 799.331132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.331259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.331375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.331544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.331701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.331796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.331857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.332036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.332157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.332319] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.835592] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.835836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.835938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.836388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.836567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.836890] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.837120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.837239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.837500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.837777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.837903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 is going to be updated. [ 799.882384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.882615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.882715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.882965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.883181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.899116] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: IN_PROGRESS for 2s [ 799.961659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 799.961912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.962122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.963029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.963029] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.354366] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 in Status: SUCCESS [ 800.354597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.354776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.354996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.355198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.355317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.355382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.355537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.355621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.355718] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.490029] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.490029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.490029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.490335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.490335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.490406] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be deleted. [ 800.573680] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.573680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.573680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.573680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.573929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.573929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.858681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.860233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.860233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.860765] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 is going to be deleted. [ 800.893886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.894115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.894224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.894481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.896771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.896771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.896771] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.404131] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.404131] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.404131] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65 already deleted. [ 801.404131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5f4e2ba-1aba-4e2f-b2b3-f074dce37c65" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529367] env[65469]: INFO networking_nsxv3.common.synchronization [req-7ffc94d2-3935-46ec-8f8b-4edfa6cce2ee req-f15a4caa-9197-463a-861c-976dba4ccce6 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 801.529916] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 801.530235] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.530393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.530734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.531111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.533087] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.533087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.533087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.533087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.533087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.533087] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.911531] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 in Status: SUCCESS [ 801.911531] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 deletion is rescheduled due to dependency. [ 801.911531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.929580] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.929778] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.929913] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.930319] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.930574] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.931084] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.931215] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.931438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.931580] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.931910] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.932039] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.932152] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.932257] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.932363] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.932464] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.932590] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.954657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.955131] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.955131] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.955252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.955545] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-8e581a58-959b-4b7a-abf7-170a10353cb2 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.955676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.955789] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.956164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.956324] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e581a58-959b-4b7a-abf7-170a10353cb2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.033656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.033819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.033897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.034145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.057727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.057978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.058462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.058462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.058462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.058721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.058721] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 802.101825] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.101825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.101825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.102097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.102150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.111846] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 802.459932] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.459932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.460634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.460634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.460634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.460733] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 8e581a58-959b-4b7a-abf7-170a10353cb2 not found, creating... [ 802.461073] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.461376] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.461679] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.461811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.461951] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.462272] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.462589] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.462589] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.462809] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.462950] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.463106] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 8e581a58-959b-4b7a-abf7-170a10353cb2 is going to be created. [ 802.485490] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.485715] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.486259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.487050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.487393] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.487667] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.222729] env[65469]: INFO networking_nsxv3.common.synchronization [req-7ffc94d2-3935-46ec-8f8b-4edfa6cce2ee req-d0f434a7-33c3-4134-95b6-0c45e4a2ebfd service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 803.223426] env[65469]: INFO networking_nsxv3.common.synchronization [req-7ffc94d2-3935-46ec-8f8b-4edfa6cce2ee req-d0f434a7-33c3-4134-95b6-0c45e4a2ebfd service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 803.223426] env[65469]: INFO networking_nsxv3.common.synchronization [req-7ffc94d2-3935-46ec-8f8b-4edfa6cce2ee req-d0f434a7-33c3-4134-95b6-0c45e4a2ebfd service nova] Enqueued Resource ID: 8e581a58-959b-4b7a-abf7-170a10353cb2 with Priority: HIGHEST for action port [ 803.223820] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 803.223963] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 803.224100] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e581a58-959b-4b7a-abf7-170a10353cb2 with Priority: HIGHEST for action port [ 803.224396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.224583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.224700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.224968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.225101] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.226420] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.226551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.227553] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e581a58-959b-4b7a-abf7-170a10353cb2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.227553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.227553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.228576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.228576] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e581a58-959b-4b7a-abf7-170a10353cb2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.730652] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.730991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.734267] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e581a58-959b-4b7a-abf7-170a10353cb2 with status ACTIVE [ 803.734515] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.734638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.734706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.734982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.735046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.735219] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.735321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.735383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.735547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.735630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.735817] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.735923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.735985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.736152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.736228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.736314] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e581a58-959b-4b7a-abf7-170a10353cb2 is going to be updated. [ 803.763254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.763405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.763493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.763773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.763943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.764142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e581a58-959b-4b7a-abf7-170a10353cb2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.123313] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 804.123673] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 804.123673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.123794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.124106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.124339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.124479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.124575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.124820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.124955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.125132] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.212173] env[65469]: INFO networking_nsxv3.common.synchronization [req-100bffa8-a641-4b13-9e08-3159f8f3b077 req-947016a1-c901-42ff-bed5-c0f292df7146 tempest-ServerMetadataTestJSON-2073972700 tempest-ServerMetadataTestJSON-2073972700-project-member] Enqueued Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 804.213161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 804.213503] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.213622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.213704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.214665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.214665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.214665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.214665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.214665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.214665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.214936] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.618963] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.619256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-845" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.619256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-845" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.623465] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-845" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.623818] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.623991] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.624124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.624387] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.624521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.624731] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.624840] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.624988] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.626652] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.626652] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.626652] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.626652] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.631581] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.658470] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.658470] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.658470] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.658470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-845" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.658470] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-d3327eea-d05e-426a-ad78-c8147d969efa taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.658470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.658470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.658470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.659122] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3327eea-d05e-426a-ad78-c8147d969efa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.719311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.719693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.719693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.721056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.721056] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 already deleted. [ 804.721056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.134629] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.164041] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.164041] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port d3327eea-d05e-426a-ad78-c8147d969efa not found, creating... [ 805.164041] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.164041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.164841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.164841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.164841] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.165039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.165180] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.165446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.165625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.165792] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: d3327eea-d05e-426a-ad78-c8147d969efa is going to be created. [ 805.190762] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.191699] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.191895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.192334] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.192759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.193207] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.637671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.637843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.637927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.638209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.638306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.638408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 805.701246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.701634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.701634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.701969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.701969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.712798] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 805.943999] env[65469]: INFO networking_nsxv3.common.synchronization [req-100bffa8-a641-4b13-9e08-3159f8f3b077 req-2005eafe-e24f-4ae6-a2e4-236be244610b service nova] Enqueued Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_rules [ 805.944313] env[65469]: INFO networking_nsxv3.common.synchronization [req-100bffa8-a641-4b13-9e08-3159f8f3b077 req-2005eafe-e24f-4ae6-a2e4-236be244610b service nova] Enqueued Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 805.944313] env[65469]: INFO networking_nsxv3.common.synchronization [req-100bffa8-a641-4b13-9e08-3159f8f3b077 req-2005eafe-e24f-4ae6-a2e4-236be244610b service nova] Enqueued Resource ID: d3327eea-d05e-426a-ad78-c8147d969efa with Priority: HIGHEST for action port [ 805.944754] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_rules [ 805.944877] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 805.944978] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3327eea-d05e-426a-ad78-c8147d969efa with Priority: HIGHEST for action port [ 805.945483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.945634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.945723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.946092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.946256] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.947165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.947606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.947723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.948656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.949022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.949179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.950989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.951210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.951997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.952140] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.953102] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3327eea-d05e-426a-ad78-c8147d969efa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.953230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.953298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.953466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.953544] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3327eea-d05e-426a-ad78-c8147d969efa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.456033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.456033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.456033] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.460539] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3327eea-d05e-426a-ad78-c8147d969efa with status ACTIVE [ 806.460755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.460885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.460959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.461228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.461319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.461536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.461826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.461826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.461826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.461958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.462140] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.462195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.462290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.462418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.462449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.462760] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3327eea-d05e-426a-ad78-c8147d969efa is going to be updated. [ 806.485699] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.486670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.486670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.486670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.486670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.486670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3327eea-d05e-426a-ad78-c8147d969efa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.956051] env[65469]: INFO networking_nsxv3.common.synchronization [req-988a3873-d4f6-4d69-a1ac-52161bcf87b6 req-f3a5776c-e538-4692-8fa9-7de5f434370c tempest-InstanceActionsV221TestJSON-692541982 tempest-InstanceActionsV221TestJSON-692541982-project-member] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 806.956239] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 806.956531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.956695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.959022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.959022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.959022] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.961480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.421780] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.422019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-307" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.423307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-307" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.423307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-307" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.423307] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.423307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.423307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.423307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.423908] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.423908] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.423908] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.423908] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.424185] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.424185] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.424185] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.424339] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.446883] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.446883] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.446883] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.446883] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-307" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.447217] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.447393] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.447509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.447839] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.447996] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3041fee7-3f3e-4799-bbfc-057ce47c1cc7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.460397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.460397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.460748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.460748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.461390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.461738] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.461991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.462481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.462768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.463028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.463187] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 already deleted. [ 807.463292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.463627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.463736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.463801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.463979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.464149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.464266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 is going to be created. [ 807.493586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.493782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.493782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.494228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.494228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.505818] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: UNINITIALIZED for 2s [ 807.724999] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 807.726039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.726039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.726039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.726236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.726347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.726414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.726574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.726655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.726775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.726902] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.952820] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.953122] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.953257] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.953537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.953704] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.953870] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 not found, creating... [ 807.954201] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.954329] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.954453] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.954745] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.955177] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.955356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.955479] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.955695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.955832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.955989] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 is going to be created. [ 807.978583] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.978863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.978918] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.979267] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.979569] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.979813] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.230051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.230249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.230338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.230959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.231193] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.231308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.231379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.231557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.231653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.231762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.231935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.232070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.232122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.232275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.232431] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.232521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.232584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.232747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.232824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.232906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.233061] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.734995] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 808.759209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.759426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.759491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.759713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.759804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.760162] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.760162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.760162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.760345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.760425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.760625] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.760719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.760783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.760917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.760992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.762351] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.762634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.762732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.762900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.762984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.763112] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 808.789703] env[65469]: INFO networking_nsxv3.common.synchronization [req-988a3873-d4f6-4d69-a1ac-52161bcf87b6 req-9ed50fef-692c-4edb-b41a-95eedec483fc service nova] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_rules [ 808.790045] env[65469]: INFO networking_nsxv3.common.synchronization [req-988a3873-d4f6-4d69-a1ac-52161bcf87b6 req-9ed50fef-692c-4edb-b41a-95eedec483fc service nova] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 808.790144] env[65469]: INFO networking_nsxv3.common.synchronization [req-988a3873-d4f6-4d69-a1ac-52161bcf87b6 req-9ed50fef-692c-4edb-b41a-95eedec483fc service nova] Enqueued Resource ID: 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 with Priority: HIGHEST for action port [ 808.790748] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_rules [ 808.790923] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 808.791227] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 with Priority: HIGHEST for action port [ 808.791863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.792129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.792252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.792632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.792753] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.794774] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.794968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.796045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.796045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.796045] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.797109] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.798114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.798232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.798430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.798542] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3041fee7-3f3e-4799-bbfc-057ce47c1cc7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.842559] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.842787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.842787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.843087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.843214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.858110] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 809.303696] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 with status ACTIVE [ 809.304112] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.304558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.304795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.305019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.305429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.305429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.305574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.305605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.305823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.305915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.306130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.306228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.306298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.306558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.306558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.306667] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3041fee7-3f3e-4799-bbfc-057ce47c1cc7 is going to be updated. [ 809.307833] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.308729] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.308848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.331390] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.331556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.331609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.331913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.332183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.332268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3041fee7-3f3e-4799-bbfc-057ce47c1cc7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.519385] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: SUCCESS [ 809.519622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.519800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.520044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.520246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.520365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.520432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.520589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.520671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.520758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.520923] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.810077] env[65469]: INFO networking_nsxv3.common.synchronization [req-5d70b7e4-2df5-4f25-b511-c98cac311f48 req-33058242-3884-4284-a956-46b2c4bce46c tempest-ServersTestJSON-1003188530 tempest-ServersTestJSON-1003188530-project-member] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 809.813069] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.813069] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 809.813069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.813069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.813069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.813271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.813271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.813412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.813444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.814045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.814045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.814045] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.025425] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.025425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.025546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.025695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.026287] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.026287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.026287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.026287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.026287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.026287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.026544] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.026544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.026639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.026687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.028040] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.028040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.028040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.028040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.028040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.028040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.028040] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.313312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.313587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.313715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.314023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.314177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.314346] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 is going to be created. [ 810.317115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.317520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.317610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.317920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.317990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.318204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.318303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.318643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.318925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.318990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.319144] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb already deleted. [ 810.319231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.325786] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.325934] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-290" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.325988] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-290" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.327443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-290" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.327728] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.327880] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.328028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.328275] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.328413] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.328614] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.328722] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.328824] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.328924] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.329152] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.329248] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.329313] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.349325] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.349599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.349599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.349742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.350190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.351926] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.352097] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.352509] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.352829] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-290" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.354213] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-cb6595db-36fc-4a61-9c46-46c2b18bb02f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.354213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.354213] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.354415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.354468] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb6595db-36fc-4a61-9c46-46c2b18bb02f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.364532] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: UNINITIALIZED for 2s [ 810.533775] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2456e406-10ff-453e-9e7e-01913e34d9c7: rpc.has_security_group_logging(os_id): False [ 810.557576] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.557576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.557576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.557576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.558135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.558135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.558289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.558530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.558605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.560629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.560629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.560629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.560629] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 is going to be created. [ 810.648198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.648356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.648618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.648618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.648790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.659956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: IN_PROGRESS for 2s [ 810.858051] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.858051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.858051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.858430] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.858554] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.858738] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port cb6595db-36fc-4a61-9c46-46c2b18bb02f not found, creating... [ 810.859112] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.859334] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.860621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.860621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.860621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.860621] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.860947] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.860982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.861259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.861425] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.861581] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: cb6595db-36fc-4a61-9c46-46c2b18bb02f is going to be created. [ 810.879373] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 810.879612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.889237] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.889237] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.892024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.892024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.892024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.892024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.435760] env[65469]: INFO networking_nsxv3.common.synchronization [None req-450d9d17-a30c-455b-a979-baae4ce0d504 None None] Enqueued Resource ID: f4626ead-8a12-4ec4-ac62-190e5c00ed5e with Priority: HIGHEST for action port [ 811.436446] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4626ead-8a12-4ec4-ac62-190e5c00ed5e with Priority: HIGHEST for action port [ 811.436787] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4626ead-8a12-4ec4-ac62-190e5c00ed5e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.436919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4626ead-8a12-4ec4-ac62-190e5c00ed5e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.437082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4626ead-8a12-4ec4-ac62-190e5c00ed5e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.437659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4626ead-8a12-4ec4-ac62-190e5c00ed5e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.437659] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4626ead-8a12-4ec4-ac62-190e5c00ed5e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [req-5d70b7e4-2df5-4f25-b511-c98cac311f48 req-936b132b-c97a-466a-b4e2-3b62db5cac48 service nova] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [req-5d70b7e4-2df5-4f25-b511-c98cac311f48 req-936b132b-c97a-466a-b4e2-3b62db5cac48 service nova] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [req-5d70b7e4-2df5-4f25-b511-c98cac311f48 req-936b132b-c97a-466a-b4e2-3b62db5cac48 service nova] Enqueued Resource ID: cb6595db-36fc-4a61-9c46-46c2b18bb02f with Priority: HIGHEST for action port [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_rules [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 811.637475] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6595db-36fc-4a61-9c46-46c2b18bb02f with Priority: HIGHEST for action port [ 811.638368] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.638368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.638368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.638368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.638368] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.638918] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.639049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.639126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.639308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.639451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.639547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.639608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.639744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.639825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.639914] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.642064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb6595db-36fc-4a61-9c46-46c2b18bb02f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.642196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.642371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.642530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.642629] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb6595db-36fc-4a61-9c46-46c2b18bb02f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.943276] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4626ead-8a12-4ec4-ac62-190e5c00ed5e [ 811.943276] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.943276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.943276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.943276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.943276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.943276] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4626ead-8a12-4ec4-ac62-190e5c00ed5e already deleted. [ 811.943276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4626ead-8a12-4ec4-ac62-190e5c00ed5e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.147386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.147386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.147386] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.149405] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb6595db-36fc-4a61-9c46-46c2b18bb02f with status ACTIVE [ 812.149714] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.150466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.150588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.150801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.151236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.152243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.152243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.152243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.152243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.152243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.152243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.152541] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb6595db-36fc-4a61-9c46-46c2b18bb02f is going to be updated. [ 812.178521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.178521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.179153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.179153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.179153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.179337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb6595db-36fc-4a61-9c46-46c2b18bb02f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.378716] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: SUCCESS [ 812.378955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.379854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.379854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.379854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.379854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.379854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.380508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.380508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.380579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.381289] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.655229] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.675219] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: SUCCESS [ 812.675459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.882839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.886052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.886052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.886052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.887130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.887434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.887434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.887797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.887797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.887797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.887981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.887981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.888118] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.162709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.163992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.163992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.163992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.163992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.163992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb is going to be created. [ 813.192722] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.192932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.192932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.193875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.193875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.208068] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: UNINITIALIZED for 2s [ 813.392504] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bff04faf-b1e3-4f4f-be69-a0b7e048e966: rpc.has_security_group_logging(os_id): False [ 813.414043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.414237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.414237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.415161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.415161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.415529] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.415529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.415529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.415712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.415712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.416289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.416289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.417049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.417049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.417049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.417049] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 is going to be created. [ 813.494558] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.494770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.494857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.495149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.495463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.513271] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: IN_PROGRESS for 2s [ 813.747741] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-a325a116-8162-4de5-a495-19a2dcbdf76d tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 813.747741] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 813.747931] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.747931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.748117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.748295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.748557] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.748712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.748967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.749216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.749299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.749429] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.252010] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.252466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.252466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.252466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.253781] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.253781] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a already deleted. [ 814.253781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.416607] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.416607] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.416607] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.417232] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.417232] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.417232] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.417446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.419555] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.419802] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.419986] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.420177] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.420643] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.420643] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.420643] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.420643] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.420798] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.446839] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.446839] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.446839] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.446839] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.446839] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.447463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.447463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.447463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.447658] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bbbd91b-8991-4c26-a532-3b3f1c4a2689',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.951091] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.951526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.951668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.951862] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.952144] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.952359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 not found, creating... [ 814.952649] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.952818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.952988] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.953488] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.953488] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.953717] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.953966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.954146] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.954415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.954500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.954668] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 is going to be created. [ 814.978228] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.978595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.978768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.979148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.979398] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.979626] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.219053] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: SUCCESS [ 815.219234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.219378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.219869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.219949] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.220641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.220641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.220641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.220641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.220850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.220850] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.329550] env[65469]: INFO networking_nsxv3.common.synchronization [None req-245e5360-14a5-4976-9fca-6198c881ce67 None None] Enqueued Resource ID: 1e073670-8aa8-42d0-8300-1ca630295a7b with Priority: HIGHEST for action port [ 815.330151] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e073670-8aa8-42d0-8300-1ca630295a7b with Priority: HIGHEST for action port [ 815.330473] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e073670-8aa8-42d0-8300-1ca630295a7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.330594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e073670-8aa8-42d0-8300-1ca630295a7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.330662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e073670-8aa8-42d0-8300-1ca630295a7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.330924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e073670-8aa8-42d0-8300-1ca630295a7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.331016] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e073670-8aa8-42d0-8300-1ca630295a7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.527384] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: SUCCESS [ 815.527726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.685638] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-1489771e-6194-4549-a183-3319b7b9061c service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 815.685638] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-1489771e-6194-4549-a183-3319b7b9061c service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 815.685638] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-1489771e-6194-4549-a183-3319b7b9061c service nova] Enqueued Resource ID: 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 with Priority: HIGHEST for action port [ 815.685638] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 815.686085] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 815.686085] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 with Priority: HIGHEST for action port [ 815.860940] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.861200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.861308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.861731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.861864] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.863013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.863265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.863265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.863480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.863692] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.863827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.863909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.864086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.864161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.864296] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.865261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.865362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.865524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.865791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.865791] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bbbd91b-8991-4c26-a532-3b3f1c4a2689',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.867971] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.869067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e073670-8aa8-42d0-8300-1ca630295a7b [ 815.869159] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.869276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.870261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.870261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.870261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.870261] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e073670-8aa8-42d0-8300-1ca630295a7b already deleted. [ 815.870261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e073670-8aa8-42d0-8300-1ca630295a7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.215073] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-2d92740e-d085-4e71-bedf-a00e0dfa424d tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 816.215632] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 816.215935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.216060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.368367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.368823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.371253] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb: rpc.has_security_group_logging(os_id): False [ 816.372386] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 with status ACTIVE [ 816.372594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.372721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.372791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.373011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.373117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.373307] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.373407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.373475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.373624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.373697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.374053] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.374053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.374824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.375052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.375252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.375401] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bbbd91b-8991-4c26-a532-3b3f1c4a2689 is going to be updated. [ 816.376495] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.394180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.394371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.394464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.394695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.394814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.395124] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.395543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.395646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.395763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb is going to be created. [ 816.401744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.401942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.402014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.402267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.402465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.402815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bbbd91b-8991-4c26-a532-3b3f1c4a2689" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.486451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.486765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.486765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.487066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.487287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.517613] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: IN_PROGRESS for 2s [ 816.731428] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.731428] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.731601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.731863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.732220] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.732461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.732614] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.733573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.733573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.733573] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.733573] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.733573] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.733573] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.733789] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.733907] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.734381] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.765207] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.765207] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.765207] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.765207] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.765207] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a111d3d6-38ac-40b3-bac6-e961ba57efc9 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.766056] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.766056] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.766970] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.767256] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a111d3d6-38ac-40b3-bac6-e961ba57efc9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.880516] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.272927] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.272927] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.272927] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.273518] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.273813] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.274125] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a111d3d6-38ac-40b3-bac6-e961ba57efc9 not found, creating... [ 817.274576] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.274947] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.275240] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.275646] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.275843] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.276385] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.276654] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.276861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.277277] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.277550] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.277773] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a111d3d6-38ac-40b3-bac6-e961ba57efc9 is going to be created. [ 817.307805] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.308199] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.308380] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.308793] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.309195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.309546] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.382629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.382629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.382629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.383329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.383329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.383329] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be created. [ 817.418097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.418555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.418651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.418882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.419226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.433304] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: UNINITIALIZED for 2s [ 817.971912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.972199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.972360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.972723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.972962] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.046242] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-84fc9ca4-330f-431a-ace0-435fa07f64fc service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 818.046451] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-84fc9ca4-330f-431a-ace0-435fa07f64fc service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 818.046562] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-84fc9ca4-330f-431a-ace0-435fa07f64fc service nova] Enqueued Resource ID: a111d3d6-38ac-40b3-bac6-e961ba57efc9 with Priority: HIGHEST for action port [ 818.048897] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 818.048897] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 818.048897] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a111d3d6-38ac-40b3-bac6-e961ba57efc9 with Priority: HIGHEST for action port [ 818.048897] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.049186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.049614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.049614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.051964] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a111d3d6-38ac-40b3-bac6-e961ba57efc9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.051964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.051964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.051964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.051964] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a111d3d6-38ac-40b3-bac6-e961ba57efc9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.475955] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.529751] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: SUCCESS [ 818.530021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.552360] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a111d3d6-38ac-40b3-bac6-e961ba57efc9 with status ACTIVE [ 818.552360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.552642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.552642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.552808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.552893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.553107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.553245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.553309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.553528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.553626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.553810] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.554324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.554324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.554324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.554324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.554324] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a111d3d6-38ac-40b3-bac6-e961ba57efc9 is going to be updated. [ 818.577974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.578210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.578319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.578764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.578934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.580028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a111d3d6-38ac-40b3-bac6-e961ba57efc9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.632759] env[65469]: INFO networking_nsxv3.common.synchronization [None req-68ab9b83-970d-4b78-9b02-a04b5202afd0 None None] Enqueued Resource ID: 2f69400a-b5ed-429b-964c-c0fa41aa56b4 with Priority: HIGHEST for action port [ 818.633353] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f69400a-b5ed-429b-964c-c0fa41aa56b4 with Priority: HIGHEST for action port [ 818.633687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f69400a-b5ed-429b-964c-c0fa41aa56b4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.633811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f69400a-b5ed-429b-964c-c0fa41aa56b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.633878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f69400a-b5ed-429b-964c-c0fa41aa56b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.634556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f69400a-b5ed-429b-964c-c0fa41aa56b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.634636] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f69400a-b5ed-429b-964c-c0fa41aa56b4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.978658] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.137317] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f69400a-b5ed-429b-964c-c0fa41aa56b4 [ 819.137578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.137726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.137806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.138048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.138147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.138244] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f69400a-b5ed-429b-964c-c0fa41aa56b4 already deleted. [ 819.138343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f69400a-b5ed-429b-964c-c0fa41aa56b4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.447160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 819.447160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.447160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.447160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.447160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.447160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.449021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.449021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.449021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.449021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.484025] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 819.484025] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 819.953040] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.010468] env[65469]: INFO networking_nsxv3.common.synchronization [None req-940ca645-2e71-4a8b-961b-bdf50295786c None None] Enqueued Resource ID: c78a2f2e-a851-4052-b7ab-a83062060bf9 with Priority: HIGHEST for action port [ 820.011239] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78a2f2e-a851-4052-b7ab-a83062060bf9 with Priority: HIGHEST for action port [ 820.011651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c78a2f2e-a851-4052-b7ab-a83062060bf9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.011781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c78a2f2e-a851-4052-b7ab-a83062060bf9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.011874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c78a2f2e-a851-4052-b7ab-a83062060bf9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.012128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c78a2f2e-a851-4052-b7ab-a83062060bf9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.012235] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78a2f2e-a851-4052-b7ab-a83062060bf9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.453905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.454060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.454105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.454301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.470802] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 820.472133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.474097] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 820.475448] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.510449] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.511152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.519338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.523225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 820.523225] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.523225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 820.523225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c78a2f2e-a851-4052-b7ab-a83062060bf9 [ 820.523225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.523225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.523225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.523225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.523225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.523225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c78a2f2e-a851-4052-b7ab-a83062060bf9 already deleted. [ 820.523225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c78a2f2e-a851-4052-b7ab-a83062060bf9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.569677] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.569677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.569867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.570015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.572670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.572878] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 820.644579] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.644802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.644802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.645020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.645260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.646285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 820.722014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.722318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.722318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.722484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.723036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.723128] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 820.725700] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1934be84-8ae3-4bd7-9b51-c38b417cac45', '31117731-2c40-474a-b432-88e9d4361256', '33207950-68c2-4f12-b68f-e8f5a186fd46', 'ee1b710f-8b96-44eb-b935-7e6dcdbe6f18', '71d94ce4-df7c-4b0a-9c44-8268f774539c', '56fa7160-9619-4025-888c-7ea4b50f157c', '9a364140-b1e3-425b-b89e-3ba5be093853', 'c9754e57-d686-47f2-9c6f-de699c5ba485', 'bff04faf-b1e3-4f4f-be69-a0b7e048e966', '709a1070-5186-40a8-ad7e-f0a18412647f', '4b4d51f5-922c-4c9c-8040-9d222ed7cbcb', 'b09b8988-0604-4099-985a-5dc6c13cf18b', 'dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00', 'c50b4159-45fc-44a4-bf5d-d24f04e41f7b', 'd0450b87-9656-4a30-b7b0-3f5285ac5d52', 'dac16e76-d38a-4051-af09-b9b6e58acda0', '80280ff5-2173-4569-9e09-d7fdc89693a7', '4e6975d0-2064-42d1-b410-13058e6b3c61', '49239a3f-71c3-4a6e-a70e-4e35fc82c66d', 'e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d', '2456e406-10ff-453e-9e7e-01913e34d9c7', '4678c753-8db4-4c5c-893f-3e320ded5c02', 'b309be15-6460-49da-bd48-e95c49f1421b', 'fb6e69ce-aa18-43cb-be60-af4e37502a7a', '92bf433d-c39b-4344-960c-b8e0607c3036', '8c49bdcf-f8e3-4883-b509-795a54e2f950', '0e0e254f-6737-4701-b8b1-b6906deeb63f', '641bf348-fb8f-499f-a944-4cb315e55733', '5faeab0c-fd4f-463f-b917-048fa4f0ebd1', 'f1fe9c7b-391a-4964-94bd-fd69c7fb232c', '7663bbf6-b391-494e-9a60-db9d723b0635', 'ab3db8e0-1f52-4d95-9b58-4be9adf31de9', '3ad20fef-905e-4efe-bdf9-75c98decc63b', '5863af48-2574-424a-a51b-dcfeb0d1a63d', '470f3367-e1b6-4e76-8701-774a6b0e92ae', '2d3a53e0-bc08-4699-b179-a2a446524a23', '1222eeb9-9dbe-496c-9f03-31010145cde2', 'aa96ab4a-8a16-4875-8013-1f1b9504c258', '1f756a88-e1c6-407c-9a54-9002d0c269ee', 'b72348dc-32e6-4663-85f1-f411e222a7a4'} {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.725700] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 820.745743] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.745743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.745743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.745743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.746785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.746785] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 820.746785] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.746785] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 820.826521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.826815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.826815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.828032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.829031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.829454] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 820.829558] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.829691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 820.829754] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 820.829829] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGH for action security_group_rules [ 820.831121] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGH for action security_group_rules [ 820.831655] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGH for action security_group_rules [ 820.831838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.980374] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.980671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.980671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.980846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.982067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.982067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 821.016587] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.016587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.016587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.016587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.016985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.030362] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 821.987108] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-309b66d5-787a-44a0-b003-d4093b991393 tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 821.988020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 821.988020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGH for action security_group_rules [ 821.988020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 with Priority: HIGH for action security_group_rules [ 821.990029] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a364140-b1e3-425b-b89e-3ba5be093853 with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGH for action security_group_rules [ 821.990642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b with Priority: HIGH for action security_group_rules [ 821.990991] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGH for action security_group_rules [ 821.991357] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 with Priority: HIGH for action security_group_rules [ 821.991624] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09b8988-0604-4099-985a-5dc6c13cf18b with Priority: HIGH for action security_group_rules [ 821.991756] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGH for action security_group_rules [ 821.991846] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 821.991942] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGH for action security_group_rules [ 821.992038] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa7160-9619-4025-888c-7ea4b50f157c with Priority: HIGH for action security_group_rules [ 821.992127] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGH for action security_group_rules [ 821.992217] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c with Priority: HIGH for action security_group_rules [ 821.992448] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31117731-2c40-474a-b432-88e9d4361256 with Priority: HIGH for action security_group_rules [ 821.992448] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGH for action security_group_rules [ 821.992717] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.992844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.994407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.994733] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.995769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33207950-68c2-4f12-b68f-e8f5a186fd46 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.995944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.996060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.996060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.997864] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33207950-68c2-4f12-b68f-e8f5a186fd46',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.998597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a364140-b1e3-425b-b89e-3ba5be093853 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.999259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.999259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.999369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.999486] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a364140-b1e3-425b-b89e-3ba5be093853',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.001252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.001433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.001523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.001885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.002027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.003946] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.003946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.003946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.004669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.004760] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.006217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.006217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.006308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.006527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.006527] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.008201] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.008312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.008430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.008633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.008633] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.011968] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.012145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.012271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.012502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.014217] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.015373] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.015514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.015565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.015735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.016158] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c50b4159-45fc-44a4-bf5d-d24f04e41f7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.016900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.017065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.017618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.017618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.017618] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.019107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.019233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.019344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.019527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.019605] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.019918] env[65469]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 822.020802] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b09b8988-0604-4099-985a-5dc6c13cf18b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.020980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.021086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.021276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.021359] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b09b8988-0604-4099-985a-5dc6c13cf18b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.022669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.022808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.022864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.023040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.023141] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.024647] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.024778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.024833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.024998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.025097] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.027488] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.027627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.027674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.027856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.027934] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.029232] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56fa7160-9619-4025-888c-7ea4b50f157c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.029387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.029387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.030033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.030033] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56fa7160-9619-4025-888c-7ea4b50f157c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.030971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.031248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.031248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.031332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.031369] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.032442] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d94ce4-df7c-4b0a-9c44-8268f774539c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.032554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.032617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.032781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.032855] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d94ce4-df7c-4b0a-9c44-8268f774539c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.034061] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31117731-2c40-474a-b432-88e9d4361256 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.034061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.034061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.034279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.034279] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31117731-2c40-474a-b432-88e9d4361256',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.035113] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.035263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.035395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.035509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.035509] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.081974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.082174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.082248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.082467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.086381] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6fe287e0-2157-4b4c-846e-fca5eb2b9339 None None] Enqueued Resource ID: 4d792f7d-4d65-444b-be8a-74b28273d222 with Priority: HIGHEST for action port [ 822.087870] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d792f7d-4d65-444b-be8a-74b28273d222 with Priority: HIGHEST for action port [ 822.087870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d792f7d-4d65-444b-be8a-74b28273d222 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.087870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d792f7d-4d65-444b-be8a-74b28273d222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.087870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d792f7d-4d65-444b-be8a-74b28273d222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.088137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d792f7d-4d65-444b-be8a-74b28273d222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.088137] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d792f7d-4d65-444b-be8a-74b28273d222',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.124785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.124785] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a364140-b1e3-425b-b89e-3ba5be093853 is going to be deleted. [ 822.211480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.211688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.211688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.211904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.211945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.212168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a364140-b1e3-425b-b89e-3ba5be093853" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.539720] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.539946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.540037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.540296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.540456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.540573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.540640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.540757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.540834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.540914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.540999] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.567863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.568605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.568605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.568605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.571376] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.571536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.579711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.579711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.579711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.579711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.579711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.579972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.580748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.580896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.581046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.581183] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.582558] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.582558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.582558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.582781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.583014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.583122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.588086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.589568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.589568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.589568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.589568] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.591015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.591157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.591233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.591414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.591631] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.591777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.591864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.592317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.592317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.592636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.592759] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.598074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.598276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.598344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.598674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.598780] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.598846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.598900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.599123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.599212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.599300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.599401] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.603954] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.604189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.604189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.605993] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.605993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.605993] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.606596] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.606781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.606894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.607673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.607673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.607997] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.612301] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.612465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.612565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.612843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.613013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.613117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.613223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.613323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.613445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.613506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.613560] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.616198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.616198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.616198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.616442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.616599] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.616700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.617362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.617362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.617362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.617362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.617362] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.620083] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.620083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.620083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.620563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.620771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.621485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.621485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.621485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.621485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.621771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.621771] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.623024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d792f7d-4d65-444b-be8a-74b28273d222 [ 822.623024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.623215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.623277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.623856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.623856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.623856] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d792f7d-4d65-444b-be8a-74b28273d222 already deleted. [ 822.623856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d792f7d-4d65-444b-be8a-74b28273d222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.627878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.628105] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33207950-68c2-4f12-b68f-e8f5a186fd46 is going to be deleted. [ 822.633305] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.633438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.633483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.635174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.668075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.668314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.669360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.669527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.670483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.670483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.671280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.672068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.672793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.672952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.676615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.676737] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be deleted. [ 822.677997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.677997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.706645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.706823] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be deleted. [ 822.709231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.709231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.725453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.725617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.735296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.735390] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c50b4159-45fc-44a4-bf5d-d24f04e41f7b is going to be deleted. [ 822.739009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.739009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.739797] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.739913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.785151] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.785151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.786413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.786687] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31117731-2c40-474a-b432-88e9d4361256 is going to be deleted. [ 822.789240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.790643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.840280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.840503] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00 is going to be deleted. [ 822.841772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.841973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.851592] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.851592] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.851592] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.851592] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.851592] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.851838] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.851838] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.852089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.852376] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.852376] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.852511] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.852651] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.852818] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.852947] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.853068] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.853218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.877037] env[65469]: INFO networking_nsxv3.common.synchronization [None req-0a627b87-6147-461f-96a0-87a640e8ebb1 None None] Enqueued Resource ID: 794ab681-3c69-4510-af42-e353d9187e3b with Priority: HIGHEST for action port [ 822.878217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.878380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.879813] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794ab681-3c69-4510-af42-e353d9187e3b with Priority: HIGHEST for action port [ 822.879813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-794ab681-3c69-4510-af42-e353d9187e3b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.879813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-794ab681-3c69-4510-af42-e353d9187e3b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.879813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-794ab681-3c69-4510-af42-e353d9187e3b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.879813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-794ab681-3c69-4510-af42-e353d9187e3b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.880258] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794ab681-3c69-4510-af42-e353d9187e3b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.889245] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.889469] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.890446] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.890446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-281" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.890446] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-7a0c910d-8bdf-45e5-a055-5f475715fcd6 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.890446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.890446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.890875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.890875] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a0c910d-8bdf-45e5-a055-5f475715fcd6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.896042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.896042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56fa7160-9619-4025-888c-7ea4b50f157c is going to be deleted. [ 822.899044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.899860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.927450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.927613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.975567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.976575] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d94ce4-df7c-4b0a-9c44-8268f774539c is going to be deleted. [ 822.977742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.980759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.986939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.986939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.044744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.044744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.044960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.045514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.045514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.045514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.045514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.045760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.045760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.045760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.047106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.047106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.047106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.047106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.048658] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.048658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.048658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.048658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.048937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.048972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.049613] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.057373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.057517] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b09b8988-0604-4099-985a-5dc6c13cf18b is going to be deleted. [ 823.059320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.059535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.059626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.059746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33207950-68c2-4f12-b68f-e8f5a186fd46" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.060017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.060093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.060216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.060353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.060886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.061191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.061344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.061441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.061750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.062074] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.062074] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.062239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c50b4159-45fc-44a4-bf5d-d24f04e41f7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.063089] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.063255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.064606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.064795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.064906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.065028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56fa7160-9619-4025-888c-7ea4b50f157c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.065312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.065436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.065497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.065547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31117731-2c40-474a-b432-88e9d4361256" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.065667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.065839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.065907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.065992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc9dfe64-71ce-4d88-94f2-0e1d5d18fc00" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.066872] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 823.067083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.067225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.067434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.067602] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.067718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.067776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.067924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.067999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.068093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.068255] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.069151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.069279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.069458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.069573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.069634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.069788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.069856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.069948] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.097631] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.097853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.097922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.098169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.098363] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.098492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.098557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.098750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.098849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.099121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.099357] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.099476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.099562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.099731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.099900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.099995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.100111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.100236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.100355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.100453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.100543] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.102843] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.104047] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.106464] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.106648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.106766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.111158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.112324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.112324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.112324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.112324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.112324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.112324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.112324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.112690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.112690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.112690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.113014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.113014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.113014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.113014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.113213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.113213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.113303] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.116804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.116804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.116804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.116804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.116804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.118033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.118033] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.118033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.118269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118484] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.118588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.118960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.119130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.119259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.119332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.119566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.119621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.119696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.119759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.119919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.119991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.120108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.120212] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.122522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.122663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.122987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.123068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.123226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.123405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.123482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.123635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.123721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.123806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.123989] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.124098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.124155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.124299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.124436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.124528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.124625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.124740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.124821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.124902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.125027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.136178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.136178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.136178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.136178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.136350] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.136350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.136427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.136549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.136634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.136951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.136951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.136951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.137139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.137175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.137311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.137405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.137462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.138320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.138320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.138320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.138320] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.142022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.142186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.142186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.142550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142550] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.142550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.142722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.142758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.142926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.143087] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.143593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.143593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.143593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.143593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.143593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.143846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.143975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.144063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.144142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.144228] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.146715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.146715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.146715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d94ce4-df7c-4b0a-9c44-8268f774539c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.177952] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.177952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.178229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.178759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.178759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.178759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b09b8988-0604-4099-985a-5dc6c13cf18b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.385026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 794ab681-3c69-4510-af42-e353d9187e3b [ 823.385646] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.385646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.385911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.386102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.386314] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:794ab681-3c69-4510-af42-e353d9187e3b already deleted. [ 823.386411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-794ab681-3c69-4510-af42-e353d9187e3b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.395412] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.395668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.395727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.396031] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.396442] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.396711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 7a0c910d-8bdf-45e5-a055-5f475715fcd6 not found, creating... [ 823.397038] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.397222] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.397373] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.397678] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.397855] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.398247] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.398413] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.398657] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.398832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.399302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.399302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 7a0c910d-8bdf-45e5-a055-5f475715fcd6 is going to be created. [ 823.423765] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.424066] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.424210] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.424524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.424826] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.425081] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.557035] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1934be84-8ae3-4bd7-9b51-c38b417cac45: rpc.has_security_group_logging(os_id): False [ 823.573544] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.573544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.573544] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.588860] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.590058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.590058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.590058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.606133] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e6975d0-2064-42d1-b410-13058e6b3c61: rpc.has_security_group_logging(os_id): False [ 823.607753] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bff04faf-b1e3-4f4f-be69-a0b7e048e966: rpc.has_security_group_logging(os_id): False [ 823.609428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb: rpc.has_security_group_logging(os_id): False [ 823.623117] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 823.624386] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80280ff5-2173-4569-9e09-d7fdc89693a7: rpc.has_security_group_logging(os_id): False [ 823.627210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.627596] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.627736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.627805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.628086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.628179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.628463] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.628564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.628627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.628812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.628894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.629189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.629319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.629391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.629626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.629734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.629734] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 823.631184] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9754e57-d686-47f2-9c6f-de699c5ba485: rpc.has_security_group_logging(os_id): False [ 823.632736] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 823.634593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.634784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.634834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.635016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.648717] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 823.652184] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.652310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.653981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.653981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.653981] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee1b710f-8b96-44eb-b935-7e6dcdbe6f18: rpc.has_security_group_logging(os_id): False [ 823.676070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.676284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.677115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.677257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.678402] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.678819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.679816] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.679966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.680875] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.681024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.681875] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.681990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.687794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.688292] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.688511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.688511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.688908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.688908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.688908] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb is going to be updated. [ 823.690441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.690674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.711614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.713228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.713228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.713228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.713228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.713228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.713228] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 823.714752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.715014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.737444] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.737444] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.737778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.737778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.737778] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.738022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.738204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.738266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 823.739428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.739596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.749633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.749852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.761555] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.761878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.772135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.772468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.772604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.772673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.772912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.773050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.773262] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.773368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.773433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.773611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.773692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.773918] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.774014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.774610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.774782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.774864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.774970] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 823.776746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.776983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.801418] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.801601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.816429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.816757] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.816993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.816993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.817216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.817309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.817502] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.817603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.817679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.817913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.818040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.818291] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.818829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.818829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.818829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.818829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.819172] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 823.820241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.820338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.978484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.978827] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.980431] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.980431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.980840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.980840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.980840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.980961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.981192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.981192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.982163] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 is going to be updated. [ 823.982638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.982799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.986081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.986081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.022079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.022079] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.022079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.022079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.022079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.022079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.022692] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.022692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.022692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.022868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.022906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.026310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.026400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.028894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.028894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.028894] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 824.028894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.028894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.028894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.029739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.032859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.032859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.032859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.042135] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6e9d9e2a-768b-44a4-a171-0d0dd5fe8379 None None] Enqueued Resource ID: 8e0dd7b7-9682-4988-b0cf-e88648a9fe13 with Priority: HIGHEST for action port [ 824.042135] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e0dd7b7-9682-4988-b0cf-e88648a9fe13 with Priority: HIGHEST for action port [ 824.042135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e0dd7b7-9682-4988-b0cf-e88648a9fe13 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.042559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e0dd7b7-9682-4988-b0cf-e88648a9fe13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.042852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e0dd7b7-9682-4988-b0cf-e88648a9fe13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.043229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e0dd7b7-9682-4988-b0cf-e88648a9fe13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.043452] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e0dd7b7-9682-4988-b0cf-e88648a9fe13',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.072566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.072745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.077480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.081847] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: IN_PROGRESS for 2s [ 824.088774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.089189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.089361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.089461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.089784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.089867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.090188] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.090341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.090431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.091449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.091662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.092023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.092122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.092203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.092416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.092531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.092667] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 824.095787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.179759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.180119] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.180330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.180462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.180647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.180746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.180972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.183034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.183347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.183429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.184065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.184065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.184065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.184529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.184529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184529] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 824.185807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.186039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.186206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.189548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.189548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.189548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.193826] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.194032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.194106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.194357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.197772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.199176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.199449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.199667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.200979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.201859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.201859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.203358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.203620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.203719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.231820] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: IN_PROGRESS for 2s [ 824.236655] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 824.238639] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 824.240845] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 824.247779] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-ba3fa418-7ec2-4974-ad54-8d564cf0fd3c service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-ba3fa418-7ec2-4974-ad54-8d564cf0fd3c service nova] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [req-3465e9a1-8a48-41b6-bc99-9768d9a07cf6 req-ba3fa418-7ec2-4974-ad54-8d564cf0fd3c service nova] Enqueued Resource ID: 7a0c910d-8bdf-45e5-a055-5f475715fcd6 with Priority: HIGHEST for action port [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_rules [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 824.262315] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0c910d-8bdf-45e5-a055-5f475715fcd6 with Priority: HIGHEST for action port [ 824.263480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.263729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.264068] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.264343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.264618] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a0c910d-8bdf-45e5-a055-5f475715fcd6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.264868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.265311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.265713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.265891] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a0c910d-8bdf-45e5-a055-5f475715fcd6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.268715] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 824.291256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.291256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.291256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.291256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.291256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.300339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.300415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.300722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.300890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.325015] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 824.327727] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 824.350385] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.350569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.350615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.350812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.350966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.380680] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 824.546943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e0dd7b7-9682-4988-b0cf-e88648a9fe13 [ 824.547197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.547334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.548645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.548645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.548645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.548645] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e0dd7b7-9682-4988-b0cf-e88648a9fe13 already deleted. [ 824.548645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e0dd7b7-9682-4988-b0cf-e88648a9fe13" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.581321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.581554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.581664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.581960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.582103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.582358] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 824.620904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.621131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.621225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.621506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.621864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.632587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 824.769976] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a0c910d-8bdf-45e5-a055-5f475715fcd6 with status ACTIVE [ 824.770258] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.770404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.770475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.770731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.770824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.771091] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.771142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.771206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.771454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.771454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.771650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.771799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.771842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.771968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.772060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.772147] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a0c910d-8bdf-45e5-a055-5f475715fcd6 is going to be updated. [ 824.806429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.806680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.806680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.806895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.807098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.807314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a0c910d-8bdf-45e5-a055-5f475715fcd6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.826539] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e8ebf45e-2a94-47d3-b1c4-4e89723d1652 None None] Enqueued Resource ID: 6576d924-2257-47ab-bafb-5bd78a427476 with Priority: HIGHEST for action port [ 824.827108] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6576d924-2257-47ab-bafb-5bd78a427476 with Priority: HIGHEST for action port [ 824.827758] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6576d924-2257-47ab-bafb-5bd78a427476 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.827758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6576d924-2257-47ab-bafb-5bd78a427476" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.827758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6576d924-2257-47ab-bafb-5bd78a427476" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.827954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6576d924-2257-47ab-bafb-5bd78a427476" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.828047] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6576d924-2257-47ab-bafb-5bd78a427476',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.005865] env[65469]: INFO networking_nsxv3.common.synchronization [None req-06ef1183-2b7a-4af5-8b0d-8f3f53e118a5 tempest-ServersV294TestFqdnHostnames-1303142590 tempest-ServersV294TestFqdnHostnames-1303142590-project-member] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 825.008920] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 825.009563] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.009697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.009789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.010090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.010191] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.038385] env[65469]: INFO networking_nsxv3.common.synchronization [req-0eca0bc1-4084-4de7-8214-0f7bceed5ed1 req-973f85a4-419c-44d1-8a38-cbf5e1592ca3 tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 825.038926] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 825.039394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.039481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.039481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.039717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.040517] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.040665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.040752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.040955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.041096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.041211] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.109661] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a27698d9-db69-4248-a7c0-00fad88ae0c5 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 825.110368] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 825.110691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.110817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.110904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.111151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.111224] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.331368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6576d924-2257-47ab-bafb-5bd78a427476 [ 825.331728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.331871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.331960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.332215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.332307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.332456] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6576d924-2257-47ab-bafb-5bd78a427476 already deleted. [ 825.332634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6576d924-2257-47ab-bafb-5bd78a427476" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.340144] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e5a3796d-7499-4f21-b064-6525ca616122 tempest-ServersV294TestFqdnHostnames-1303142590 tempest-ServersV294TestFqdnHostnames-1303142590-project-member] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 825.342139] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 825.343463] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.343463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.432978] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8229feb4-436b-495f-ad2f-386a3ca416f3 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 825.432978] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 825.432978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.432978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.533676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.533861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.533955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.534119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.534208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.534311] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 already deleted. [ 825.534398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.534556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.534720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.534883] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.543696] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.629051] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.629360] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.629474] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.629955] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.630287] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.630457] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.630573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.630840] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.630992] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.631220] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.631332] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.631566] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.631707] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.631821] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.631924] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.632067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.637983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.638164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.638164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.638364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.638445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.638533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 already deleted. [ 825.638610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.638751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.638930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.639037] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.651239] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.651412] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.651591] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.651760] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.652082] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-4e1b9bc8-348e-4380-bafa-9e084d885ee1 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.652282] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.652501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.652920] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.653135] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e1b9bc8-348e-4380-bafa-9e084d885ee1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.045853] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.057940] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.058113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.058176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.058381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.058467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.058558] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 already deleted. [ 826.058638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.104110] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: SUCCESS [ 826.104378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.157250] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.157521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.157649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.157927] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.158091] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.158254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 4e1b9bc8-348e-4380-bafa-9e084d885ee1 not found, creating... [ 826.158525] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.158717] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.158920] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.159299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.159575] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.160129] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.160357] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.160554] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.160863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.161092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.161286] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 4e1b9bc8-348e-4380-bafa-9e084d885ee1 is going to be created. [ 826.163538] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.163655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.163723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.163881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.163960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.164057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 already deleted. [ 826.164138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.185295] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.185295] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.185565] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.185901] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.186234] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.186602] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.265352] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: SUCCESS [ 826.265632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.267735] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 826.267735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.268592] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 826.268831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.270553] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 826.270735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.287578] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 826.287796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.300577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 826.300821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.344598] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 826.344598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.345223] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 826.345435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.402254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 826.402493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.548097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.548345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.552508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 826.584818] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.584999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.585065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.585253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.585407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.595910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 826.649220] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 826.649568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.649819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.650155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.650541] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.650759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.650846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.651038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.651130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.651241] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.062599] env[65469]: INFO networking_nsxv3.common.synchronization [req-0eca0bc1-4084-4de7-8214-0f7bceed5ed1 req-a4e18981-8056-4d40-92eb-4c3dc07109d4 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 827.062875] env[65469]: INFO networking_nsxv3.common.synchronization [req-0eca0bc1-4084-4de7-8214-0f7bceed5ed1 req-a4e18981-8056-4d40-92eb-4c3dc07109d4 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 827.062923] env[65469]: INFO networking_nsxv3.common.synchronization [req-0eca0bc1-4084-4de7-8214-0f7bceed5ed1 req-a4e18981-8056-4d40-92eb-4c3dc07109d4 service nova] Enqueued Resource ID: 4e1b9bc8-348e-4380-bafa-9e084d885ee1 with Priority: HIGHEST for action port [ 827.064963] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 827.065160] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 827.065564] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1b9bc8-348e-4380-bafa-9e084d885ee1 with Priority: HIGHEST for action port [ 827.066377] env[65469]: INFO networking_nsxv3.common.synchronization [req-fa40a3f7-a568-4dd4-bba3-7f4d01b6a8c5 req-c06764a1-42de-4cdc-a89b-0f0bbc2a7c58 tempest-InstanceActionsV221TestJSON-692541982 tempest-InstanceActionsV221TestJSON-692541982-project-member] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 827.066929] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.067065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.067134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.067330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.067408] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.068546] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.068721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.068834] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e1b9bc8-348e-4380-bafa-9e084d885ee1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.068912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.069069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.069183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.069371] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e1b9bc8-348e-4380-bafa-9e084d885ee1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.071704] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGHEST for action security_group_members [ 827.071704] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.071704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.071704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.071704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.071704] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.071704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.071704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.072172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.072172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.072172] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.153982] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.571244] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.571387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.576072] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e1b9bc8-348e-4380-bafa-9e084d885ee1 with status ACTIVE [ 827.576304] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.576438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.576507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.576731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.576849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.577063] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.577167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.577228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.577427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.577588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.577697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.577794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.577859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.577991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.578078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.578165] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e1b9bc8-348e-4380-bafa-9e084d885ee1 is going to be updated. [ 827.579375] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.579486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.579554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.579704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.579785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.579950] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.580373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.580478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.580633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.580711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.580800] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 is going to be updated. [ 827.608267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.608445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.608498] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.608678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.608816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.609073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e1b9bc8-348e-4380-bafa-9e084d885ee1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.612598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.612784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.612784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.612994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.613147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.621756] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: IN_PROGRESS for 2s [ 827.656316] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.159098] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.159487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.159487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.159669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.159765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.159867] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 828.195271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.195271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.195271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.195271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.195271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.205756] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 828.610264] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 828.610495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.611542] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.611542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.611897] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.114948] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.620550] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.635722] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 in Status: SUCCESS [ 829.635898] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 deletion is rescheduled due to dependency. [ 829.636025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.126951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.126951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.126951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.126951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.126951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.126951] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 830.191128] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.191309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.191716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.191716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.191895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.216015] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 830.226843] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 4s [ 830.716295] env[65469]: INFO networking_nsxv3.common.synchronization [req-db0e72d3-969c-4f50-8859-f5685dfe139e req-6c00b8c5-6d17-497b-bf11-d5e7ee40291e tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 830.716906] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 830.719562] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.719562] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.719562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.719562] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.222850] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.222850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.222850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.222850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.245204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.245649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.245891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.245982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.246239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.246325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.246418] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be updated. [ 831.280980] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.281109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.281172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.281372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.281530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.300983] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 831.798952] env[65469]: INFO networking_nsxv3.common.synchronization [req-91a7cfc7-3fae-406c-bae5-3cc33aa7fea4 req-c3be2795-bc00-41a7-9280-8796420e5752 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 831.799687] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 831.800064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.800197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.800264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.800643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.800836] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.800954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.801035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.801210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.801311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.801415] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.228676] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 832.228911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.229119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.229474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.229678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.229822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.229881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.230074] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.230159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.230319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.230441] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.234992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 832.235320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.235486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.236094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.236094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.236094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.236630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.236630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.236630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.236630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.236920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.236920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.237063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.237100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.237229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.237297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.237446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.237446] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.238323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.238495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.238643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.238747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.239097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.239097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.239097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.239397] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.252634] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.252867] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.253469] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.253469] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.253469] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.253737] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.253779] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.253966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.254117] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.254339] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.254476] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.254615] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.254693] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.254797] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.254903] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.255050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.285597] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.285786] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.285925] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.286141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.286459] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.287115] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.287397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.287748] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.287890] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a974f4bb-1d41-4ab4-bb33-c81f359ccdb9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.307267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.307267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.307267] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 already deleted. [ 832.307267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.732394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.732590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.732681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.732891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.733281] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.733395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.733464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.733639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.733724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.733811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.733979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.734107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.734167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.734309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.734447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.734536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.734622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.734770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.734846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.734926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.735027] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.740979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93250c38-ef03-4516-b959-0aa8baeef74a: rpc.has_security_group_logging(os_id): False [ 832.741999] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.759841] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.760065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.760065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.760289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.760359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.760670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.760777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.760777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.760939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.761040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.761241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.761329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.761392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.761538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.761598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.761785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.761875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.761934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.762078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.762150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.762234] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be created. [ 832.791109] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.791355] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.791490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.792666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.792666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.792666] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 not found, creating... [ 832.792666] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.792666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.792666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.793011] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.793011] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.793306] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.793460] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.793573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.793780] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.793906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.794812] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 is going to be created. [ 832.825914] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.826359] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.826359] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.826618] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.826906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.827206] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.844523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.844660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.844660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.844926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.845184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.872433] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 833.239259] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb6e69ce-aa18-43cb-be60-af4e37502a7a: rpc.has_security_group_logging(os_id): False [ 833.244946] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.264471] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.264655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.264729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.264943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.288205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.288494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.288633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.288701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.288944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.289144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.289596] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.289735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.289801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.289994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.290099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.290385] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.290489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.290534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.290898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.291021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.291115] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 833.315341] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 833.315341] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 deletion is rescheduled due to dependency. [ 833.315341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.387597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.387926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.387926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.388080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.388253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.405806] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 833.532705] env[65469]: INFO networking_nsxv3.common.synchronization [req-91a7cfc7-3fae-406c-bae5-3cc33aa7fea4 req-4884a0bb-14df-4e43-b91b-d88a4ecb147e service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 833.532888] env[65469]: INFO networking_nsxv3.common.synchronization [req-91a7cfc7-3fae-406c-bae5-3cc33aa7fea4 req-4884a0bb-14df-4e43-b91b-d88a4ecb147e service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 833.533325] env[65469]: INFO networking_nsxv3.common.synchronization [req-91a7cfc7-3fae-406c-bae5-3cc33aa7fea4 req-4884a0bb-14df-4e43-b91b-d88a4ecb147e service nova] Enqueued Resource ID: a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 with Priority: HIGHEST for action port [ 833.533767] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 833.533913] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 833.534040] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 with Priority: HIGHEST for action port [ 833.534418] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.534553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.534658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.534918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.535041] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.540610] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.540610] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.540610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.540610] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.545522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.545522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.545522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.545522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.545729] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a974f4bb-1d41-4ab4-bb33-c81f359ccdb9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.747754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.747932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.748057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.748353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.748531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.748681] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 833.785441] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.786698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.786698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.786698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.787340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.798826] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 833.951877] env[65469]: INFO networking_nsxv3.common.synchronization [None req-15bf3c22-965c-4c05-9a58-a5b1094992ad None None] Enqueued Resource ID: 7f3ec383-2421-4921-919f-db10a1a4f2e3 with Priority: HIGHEST for action port [ 833.952540] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ec383-2421-4921-919f-db10a1a4f2e3 with Priority: HIGHEST for action port [ 833.952959] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f3ec383-2421-4921-919f-db10a1a4f2e3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.953212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f3ec383-2421-4921-919f-db10a1a4f2e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.953256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f3ec383-2421-4921-919f-db10a1a4f2e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.954266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f3ec383-2421-4921-919f-db10a1a4f2e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.954266] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3ec383-2421-4921-919f-db10a1a4f2e3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.050747] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.050747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.050747] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.052419] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 with status ACTIVE [ 834.052831] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.052831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.053482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.053482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.053482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.053482] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.053762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.053762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.053762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.056083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.056083] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.056083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.056083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.056083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.056083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.056083] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a974f4bb-1d41-4ab4-bb33-c81f359ccdb9 is going to be updated. [ 834.082709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.082709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.082858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.083137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.083137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.084166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a974f4bb-1d41-4ab4-bb33-c81f359ccdb9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.457981] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f3ec383-2421-4921-919f-db10a1a4f2e3 [ 834.458250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.458901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.458901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.458901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.458901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.458901] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f3ec383-2421-4921-919f-db10a1a4f2e3 already deleted. [ 834.458901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f3ec383-2421-4921-919f-db10a1a4f2e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.553149] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.888359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 834.889056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.889056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.889056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.889542] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.059041] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.059041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.059041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.059628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.059628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.059628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be created. [ 835.086243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.086428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.086501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.086664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.087200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.099656] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: UNINITIALIZED for 2s [ 835.391796] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.391965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.429844] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 835.430087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.811835] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 835.812079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.812432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.812565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.812694] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.812816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.812881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.813065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.813151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.813267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.813314] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.317371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.317715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.317777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.317985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.318205] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.318324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.318402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.318580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.318683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.318797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.319317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.319430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.319468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.319678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.319893] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.320716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.320716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.320716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.320716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.320716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.320716] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.768928] env[65469]: INFO networking_nsxv3.common.synchronization [None req-49f84a1a-3d1a-4fca-8d1c-800e1210127d None None] Enqueued Resource ID: f24890d5-9dea-405d-a597-d6aa8cfccee7 with Priority: HIGHEST for action port [ 836.768928] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24890d5-9dea-405d-a597-d6aa8cfccee7 with Priority: HIGHEST for action port [ 836.769264] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f24890d5-9dea-405d-a597-d6aa8cfccee7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.769398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f24890d5-9dea-405d-a597-d6aa8cfccee7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.769461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f24890d5-9dea-405d-a597-d6aa8cfccee7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.769713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f24890d5-9dea-405d-a597-d6aa8cfccee7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.769811] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24890d5-9dea-405d-a597-d6aa8cfccee7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.822951] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93250c38-ef03-4516-b959-0aa8baeef74a: rpc.has_security_group_logging(os_id): False [ 836.842577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.842726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.842792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.843633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.843633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.844140] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.844140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.844140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.844140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.844397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.844397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.844529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.844529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.844688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.844760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.845034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 836.918364] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.918561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.918609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.918784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.918934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.936312] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 837.125050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 837.125371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.125558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.125782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.126149] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.126149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.126297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.126513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.126513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.126513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.126616] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.272932] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f24890d5-9dea-405d-a597-d6aa8cfccee7 [ 837.273207] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.273361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.273654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.273755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273874] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f24890d5-9dea-405d-a597-d6aa8cfccee7 already deleted. [ 837.273967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f24890d5-9dea-405d-a597-d6aa8cfccee7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.630979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.631370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.631370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.632150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.632150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.632150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.632324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.632551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.632551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.632698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.632923] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.633087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.633186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.633407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.633624] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.633772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.633871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.635240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.635240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.635240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.635240] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.673982] env[65469]: INFO networking_nsxv3.common.synchronization [req-43465180-d33d-4086-81fc-354dea947c61 req-6f3e0079-8fbd-4c30-95a3-7634b5710de7 tempest-DeleteServersAdminTestJSON-1207111285 tempest-DeleteServersAdminTestJSON-1207111285-project-member] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 837.674693] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 837.677366] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.677540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.677614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.677878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.678065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.678172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.678236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.678418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.678509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.678603] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.970747] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.970953] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.971072] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.971351] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.971604] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.971802] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.971920] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.972164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.972309] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.972579] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.972650] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.972713] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.972820] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.972924] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.973086] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.973214] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.999650] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.999806] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.999944] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.000141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.000500] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-5686a2a4-67f5-4e7c-be1e-2bf93d810607 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.000680] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.000799] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.001118] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.001256] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5686a2a4-67f5-4e7c-be1e-2bf93d810607',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.138788] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6f27ff1-776e-4a70-90a6-ebc268939e44: rpc.has_security_group_logging(os_id): False [ 838.156946] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.157221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.157351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.157673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.157941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.158883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.158883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.158883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.158883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.158883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.159162] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.159280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.159374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.159629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.159756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.160099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.160280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.160591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.160660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.160757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.160890] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be created. [ 838.181933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.182173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.182283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.182546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.182652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.182880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.182995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.183077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.183259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.183349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.183452] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 already deleted. [ 838.183589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.224369] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.224991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.225111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.225307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.225546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.239026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 838.503793] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.504076] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.504256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.504647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.504821] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.505050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 5686a2a4-67f5-4e7c-be1e-2bf93d810607 not found, creating... [ 838.505410] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.505596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.505717] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.505970] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.506481] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.506846] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.508434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.509102] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.509987] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.510183] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.510340] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 5686a2a4-67f5-4e7c-be1e-2bf93d810607 is going to be created. [ 838.532917] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.533180] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.533293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.533578] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.533832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.534088] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.950686] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 838.951109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.951202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.951500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.951638] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.288351] env[65469]: INFO networking_nsxv3.common.synchronization [req-43465180-d33d-4086-81fc-354dea947c61 req-67ef8ad7-be4b-415c-b458-8f3576396370 service nova] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_rules [ 839.288351] env[65469]: INFO networking_nsxv3.common.synchronization [req-43465180-d33d-4086-81fc-354dea947c61 req-67ef8ad7-be4b-415c-b458-8f3576396370 service nova] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 839.288351] env[65469]: INFO networking_nsxv3.common.synchronization [req-43465180-d33d-4086-81fc-354dea947c61 req-67ef8ad7-be4b-415c-b458-8f3576396370 service nova] Enqueued Resource ID: 5686a2a4-67f5-4e7c-be1e-2bf93d810607 with Priority: HIGHEST for action port [ 839.288627] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_rules [ 839.288627] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 839.288742] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5686a2a4-67f5-4e7c-be1e-2bf93d810607 with Priority: HIGHEST for action port [ 839.288951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.289115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.289191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.289451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.289531] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.290469] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.290640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.290640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.290820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.290969] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.291173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.291173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.291285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.291342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.291410] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.292620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5686a2a4-67f5-4e7c-be1e-2bf93d810607 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.292620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.292620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.292620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.294018] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5686a2a4-67f5-4e7c-be1e-2bf93d810607',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.455562] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.455924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.456115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.456475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.458598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.458754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.458866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.459092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.459294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.459461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.459617] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.795917] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.796071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.796270] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.797145] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5686a2a4-67f5-4e7c-be1e-2bf93d810607 with status ACTIVE [ 839.797349] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.797467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.797531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.798184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.798184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.798184] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.798184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.798184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.798456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.798456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.798523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.798614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.798678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.798789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.798887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.798964] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5686a2a4-67f5-4e7c-be1e-2bf93d810607 is going to be updated. [ 839.821567] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.821795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.821795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.821978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.822137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.822437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5686a2a4-67f5-4e7c-be1e-2bf93d810607" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.963602] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.963917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.963917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.964118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.964289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.964516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.964604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.964793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.964892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.964989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.965165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.965266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.965328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.965552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.965771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.965889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.965961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.966597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.966695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.966948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.966948] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.251961] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 840.252278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.301608] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.353556] env[65469]: INFO networking_nsxv3.common.synchronization [req-316ce7d0-f297-48a7-8e10-5929f19b9e23 req-f6be97a9-1aaa-4bb7-b6b0-1f9a38e7eb06 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 840.354206] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 840.354573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.354718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.354789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.355023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.355197] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.355670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.355740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.355908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.355995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.356106] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.468956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93250c38-ef03-4516-b959-0aa8baeef74a: rpc.has_security_group_logging(os_id): False [ 840.494025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.494025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.494025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.494025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.494589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.494589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.494589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.494589] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.494734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.494734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.494884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.494946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.496169] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 840.587571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.588383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.588383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.588383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.588383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.610867] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 840.805346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.805481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.805531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.805738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.805824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.805942] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be created. [ 840.807813] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.807998] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.808299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.808563] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.808818] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.808988] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.809121] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.809428] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.809531] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.809719] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.809832] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.809938] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.810064] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.810176] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.810297] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.810453] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.830393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.830603] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.830745] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.830936] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.831562] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.831562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.831753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.831958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.832113] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffe66a7-7454-4f12-a23d-9636ca7d7be8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.836277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.836413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.836540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.836869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.836996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.846879] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: UNINITIALIZED for 2s [ 840.858153] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.335060] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.335835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.335835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.335835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.335835] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.336093] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 not found, creating... [ 841.336204] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.336386] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.336506] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.336735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.336873] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.337198] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.337352] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.337470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.337683] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.337821] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.337958] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 is going to be created. [ 841.360728] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.376400] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.376658] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.376806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.377108] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.377493] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.377713] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.571344] env[65469]: INFO networking_nsxv3.common.synchronization [req-d6da06a6-69df-4948-9bf1-128dc1a75ebe req-eb2300cf-7e72-421e-919a-cc554349e6de tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 841.571986] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 841.572339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.572458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.572526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.572721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.572868] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.572964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.573039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.573240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.573371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.573470] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.863844] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.864139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.864303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.864526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.864696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.864853] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 841.916396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.916396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.916396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.916396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.916396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.935157] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 842.078673] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.103440] env[65469]: INFO networking_nsxv3.common.synchronization [req-316ce7d0-f297-48a7-8e10-5929f19b9e23 req-8337f2e5-0afa-4d93-b8bf-1a659fa4e2a7 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 842.103662] env[65469]: INFO networking_nsxv3.common.synchronization [req-316ce7d0-f297-48a7-8e10-5929f19b9e23 req-8337f2e5-0afa-4d93-b8bf-1a659fa4e2a7 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 842.103806] env[65469]: INFO networking_nsxv3.common.synchronization [req-316ce7d0-f297-48a7-8e10-5929f19b9e23 req-8337f2e5-0afa-4d93-b8bf-1a659fa4e2a7 service nova] Enqueued Resource ID: 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 with Priority: HIGHEST for action port [ 842.108024] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 842.108024] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 842.108024] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 with Priority: HIGHEST for action port [ 842.108024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.108024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.108024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.108024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.108024] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.109249] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.109993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.110356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.110356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.110653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.111136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.111755] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffe66a7-7454-4f12-a23d-9636ca7d7be8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.583225] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.609227] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.609410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.614203] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 with status ACTIVE [ 842.614584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.614751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.614843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.615102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.615203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.615385] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.615468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.615641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.615791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.615918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.616147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.616254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.616334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.616487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.616576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.616664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ffe66a7-7454-4f12-a23d-9636ca7d7be8 is going to be updated. [ 842.631664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 842.631945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.642333] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.642333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.642333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.642333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.642333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.642333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ffe66a7-7454-4f12-a23d-9636ca7d7be8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.858489] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 842.859831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.859831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.860410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.860410] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.860410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.860410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.860655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.860697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.860845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.860938] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.974566] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0ed4fa3-54b5-45db-b220-447dd163c0ad req-13cf5a66-87fa-44c6-9a14-6bf38ab3220f tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 842.975209] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 842.976414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.976414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.976414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.976414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.976414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.976414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.976768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.976844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.977878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.978096] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.087585] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.087585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.087585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.087585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.087585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.087585] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 843.125344] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.125525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.126967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.126967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.126967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.145363] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 843.366016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.366016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.366016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.366016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.366906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.366906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.366906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.366906] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.401233] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.401426] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-686" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.401545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-686" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.401875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-686" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.402235] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.402510] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.402659] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.403359] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.403359] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.403359] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.403576] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.403933] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.403933] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.404730] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.404730] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.404730] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.432039] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.432231] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.432394] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.432549] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-686" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432997] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-06785ac4-1625-41d1-a882-284a7be309fc taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.433252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.433421] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.433853] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.434216] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06785ac4-1625-41d1-a882-284a7be309fc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.482395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.482615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.482679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.483020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.483020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.483267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.483367] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.483429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.483640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.483771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.483842] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 already deleted. [ 843.483973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.869641] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d29c1b7-7d3c-4651-9e62-14cee71b96b1: rpc.has_security_group_logging(os_id): False [ 843.893024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.893024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.893024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.893024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.894214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.894214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.894214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.894633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.894931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.895735] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be created. [ 843.937973] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.938215] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.938379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.938742] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.938890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.939059] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 06785ac4-1625-41d1-a882-284a7be309fc not found, creating... [ 843.939391] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.939639] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.939765] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.939978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.940127] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.940516] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.940683] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.940806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.941048] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.941187] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.941331] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 06785ac4-1625-41d1-a882-284a7be309fc is going to be created. [ 843.956041] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 843.956041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.956225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.956670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.956979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.957103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.957103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.957888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.957888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.957888] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.967417] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.967417] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.967671] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.967984] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.968339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.968656] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.980337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.980469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.980516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.980774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.980982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.993555] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 844.459846] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.678015] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0ed4fa3-54b5-45db-b220-447dd163c0ad req-f8cacc27-17c2-44c7-8168-3a5642cf9a90 service nova] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 844.678161] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0ed4fa3-54b5-45db-b220-447dd163c0ad req-f8cacc27-17c2-44c7-8168-3a5642cf9a90 service nova] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 844.678301] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0ed4fa3-54b5-45db-b220-447dd163c0ad req-f8cacc27-17c2-44c7-8168-3a5642cf9a90 service nova] Enqueued Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 844.678795] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 844.679020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 844.679175] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 844.679534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.679660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.679730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.680094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.680094] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.680902] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.681018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.681192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.681253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.681392] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.681524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.681574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.681680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.681763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.681853] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.682661] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-06785ac4-1625-41d1-a882-284a7be309fc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.682765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.682765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.682903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.682964] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06785ac4-1625-41d1-a882-284a7be309fc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.965260] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.090469] env[65469]: INFO networking_nsxv3.common.synchronization [req-30311af9-2989-45fc-9b2d-b7d5851b847a req-46f8268f-5488-4534-a875-0d8631c4eb2d tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 845.090659] env[65469]: INFO networking_nsxv3.common.synchronization [req-30311af9-2989-45fc-9b2d-b7d5851b847a req-46f8268f-5488-4534-a875-0d8631c4eb2d tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 845.090796] env[65469]: INFO networking_nsxv3.common.synchronization [req-30311af9-2989-45fc-9b2d-b7d5851b847a req-46f8268f-5488-4534-a875-0d8631c4eb2d tempest-SecurityGroupsTestJSON-1734216756 tempest-SecurityGroupsTestJSON-1734216756-project-member] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 845.095109] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGHEST for action security_group_members [ 845.095109] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGHEST for action security_group_members [ 845.095109] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGHEST for action security_group_members [ 845.095109] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.095109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.095109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.095109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.095748] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.095748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.095748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.095748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.095748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.095748] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.097495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.097495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.097495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.097495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.098398] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.098489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.098489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.098801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.098801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.098907] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.100253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.101254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.101254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.101254] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.154838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 845.154958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.184524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.185628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.185754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.185914] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06785ac4-1625-41d1-a882-284a7be309fc with status ACTIVE [ 845.186126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.186245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.186312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.186521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.186650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.186855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.186971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.187085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.189495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.189495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.189495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06785ac4-1625-41d1-a882-284a7be309fc is going to be updated. [ 845.213263] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.213669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.213811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.213972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.471989] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.472566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.472566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.472566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.472566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.472763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 845.515779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.516501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.516501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.517148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.517345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.527888] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 845.603600] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.603945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.603945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.604223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.604324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.604586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.604690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.604750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.604927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.605101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.605204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be updated. [ 845.609214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.609214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.609214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.609214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.609214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.609214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.641766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.642288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.642482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.642579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.642842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.642977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.643131] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 is going to be updated. [ 845.649020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.649020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.650783] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.650892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.650977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.651163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.651303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.661290] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: IN_PROGRESS for 2s [ 845.671173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.671456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.671580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.671781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.671884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.671936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.672000] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be updated. [ 845.682321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.682518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.682622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.682850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.683165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.692262] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.692597] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: IN_PROGRESS for 2s [ 845.706270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.706480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.706480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.706707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.706844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.716938] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: IN_PROGRESS for 2s [ 845.926023] env[65469]: INFO networking_nsxv3.common.synchronization [req-43dc6649-efef-41ab-b95f-e197b22b60fe req-ddaf50a8-f865-481d-841e-8ec58708960a tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 845.926593] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 845.927018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.927283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.927372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.927592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.927779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.927848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.927953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.928075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.928155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.928264] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.008356] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 846.008853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.195706] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.195706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.195942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.195987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.196179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.196417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be created. [ 846.223711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.223902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.223978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.225049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.225049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.235933] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: UNINITIALIZED for 2s [ 846.337899] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.337899] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.338822] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.338822] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.338822] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.339031] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.339195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.339490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.339640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.339851] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.339962] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.340136] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.340201] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.340364] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.340430] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.340746] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.369948] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.370067] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.370193] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.370602] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.373730] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.373730] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.373730] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.373730] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.373730] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bf3b32-ceea-4c25-9ed4-b9df8566ecae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.431392] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.431567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.431642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.431861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.431951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.432167] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.432299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.432355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.432470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.432541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.432630] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be deleted. [ 846.467724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.468080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.468080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.468277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.468277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.468402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.875733] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.876031] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.876179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.876531] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.876746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.876949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port d5bf3b32-ceea-4c25-9ed4-b9df8566ecae not found, creating... [ 846.877271] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.877503] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.877655] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.877902] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.878054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.878344] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.878501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.878643] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.878940] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.879416] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.879605] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: d5bf3b32-ceea-4c25-9ed4-b9df8566ecae is going to be created. [ 846.906057] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.906344] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.906574] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.906916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.907188] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.907507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.539171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 847.541249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.541975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.542842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.542842] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.542959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.543014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.543191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.543266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.543354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.543448] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.607149] env[65469]: INFO networking_nsxv3.common.synchronization [req-43dc6649-efef-41ab-b95f-e197b22b60fe req-7000ec7b-1163-4615-8b8d-b688f0787da7 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 847.607543] env[65469]: INFO networking_nsxv3.common.synchronization [req-43dc6649-efef-41ab-b95f-e197b22b60fe req-7000ec7b-1163-4615-8b8d-b688f0787da7 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 847.607733] env[65469]: INFO networking_nsxv3.common.synchronization [req-43dc6649-efef-41ab-b95f-e197b22b60fe req-7000ec7b-1163-4615-8b8d-b688f0787da7 service nova] Enqueued Resource ID: d5bf3b32-ceea-4c25-9ed4-b9df8566ecae with Priority: HIGHEST for action port [ 847.608600] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 847.608812] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 847.608970] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5bf3b32-ceea-4c25-9ed4-b9df8566ecae with Priority: HIGHEST for action port [ 847.610045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.610045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.610045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.610045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.610045] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.612196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.612325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.612396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.612588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.612744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.612843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.612905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.613064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.613149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.613250] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.614096] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.614206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.614274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.614426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.614506] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bf3b32-ceea-4c25-9ed4-b9df8566ecae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.671388] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9754e57-d686-47f2-9c6f-de699c5ba485 in Status: SUCCESS [ 847.671606] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 deletion is rescheduled due to dependency. [ 847.671730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.704864] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 in Status: SUCCESS [ 847.705015] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 deletion is rescheduled due to dependency. [ 847.705087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.728906] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f in Status: SUCCESS [ 847.729169] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f deletion is rescheduled due to dependency. [ 847.729398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.046254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.046453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.046543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.046810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.047021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.047127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.047210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.047390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.047490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.047636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.047767] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.047878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.047941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.048130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.048272] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.048391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.048457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.048644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.048743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.048835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.048956] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.117393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.117393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.117393] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.119094] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5bf3b32-ceea-4c25-9ed4-b9df8566ecae with status ACTIVE [ 848.119094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.119094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.119094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.119094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.119094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.119094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.119506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.119506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.119506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.119654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.120059] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.120059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.120059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.120229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.120229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.120334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5bf3b32-ceea-4c25-9ed4-b9df8566ecae is going to be updated. [ 848.143994] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.143994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.143994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.144303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.144914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.144914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5bf3b32-ceea-4c25-9ed4-b9df8566ecae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.247278] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 848.247555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.247801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.247960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.248225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.248324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.248324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.248475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.248552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.248630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.248727] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.551699] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 848.572140] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.572593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.572593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.572593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.572746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.572921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.573059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.573059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.573179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.573253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.573437] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.573534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.573591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.573712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.573918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.574177] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.574451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.574451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.574578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.574578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.574646] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 848.595798] env[65469]: INFO networking_nsxv3.common.synchronization [req-2c872c17-7bcb-4baf-9eec-2e9da1d7d32b req-49f3ada4-6c1e-4b48-bcd7-269cba35586a tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 848.596348] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 848.596687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.596842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.596915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.597526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.597526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.597629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.597682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.597842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.597934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.598049] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.621901] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.640083] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.640541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.640541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.640541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.640696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.659964] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 848.751886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.752080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.752132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.752350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.752518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.752623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.752684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.753682] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.753682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.753682] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.754128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.754128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.754128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.754128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.754128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.754295] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.100316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.100661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.100661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.100889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.101027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.101201] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.101358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.101358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.101518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.101600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.101730] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 849.128030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.128030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.128030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.128030] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be created. [ 849.144169] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.144169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.144169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.144515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.144623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.155432] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 849.176760] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.176760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.176760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.176760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.176760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.196073] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: UNINITIALIZED for 2s [ 849.256900] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b750a3b-8e4a-4042-b72c-957a6d79cdc8: rpc.has_security_group_logging(os_id): False [ 849.281585] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.282186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.282186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.283692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.283915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.284141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.284297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.284370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.284685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.284803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.287581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.287581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.287581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.287581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.287581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.289434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.289434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.289434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.289434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.289434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.289434] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be created. [ 849.464033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.464033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.464033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.464033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.464033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.515746] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 849.866798] env[65469]: INFO networking_nsxv3.common.synchronization [req-42dbe150-eadd-443a-935b-e72369927e47 req-a8e5277a-e8da-417b-8667-28767c32e103 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 849.867644] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 849.868030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.868204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.868276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.868483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.868722] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.868847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.868941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.869211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.869313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.869628] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.099985] env[65469]: INFO networking_nsxv3.common.synchronization [req-08ba0ab4-f1c0-4ed6-9d50-790e3f29e2b6 req-70d27b65-b796-4c37-90fc-4b1aacabd2e3 tempest-ListImageFiltersTestJSON-1904470615 tempest-ListImageFiltersTestJSON-1904470615-project-member] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 850.099985] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 850.099985] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.100382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.100466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.100672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.100822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.100925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.100989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.101159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.101249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.101345] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.375317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.376434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.376434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.376861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.376985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.377132] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 850.418678] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.418678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.418678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.418985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.419041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.429334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 850.529425] env[65469]: INFO networking_nsxv3.common.synchronization [req-aa979df8-332f-4be6-a6c2-d5d945cbd9e7 req-48ba52a2-5482-43ec-9871-d7ff9c420cc5 tempest-ServerMetadataTestJSON-2073972700 tempest-ServerMetadataTestJSON-2073972700-project-member] Enqueued Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 850.531611] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGHEST for action security_group_members [ 850.532014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.532199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.532303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.532569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.532774] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.532906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.533013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.533213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.533330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.533477] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.607987] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.683423] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 850.683423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.037712] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.038106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.038106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.038193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.041527] env[65469]: INFO networking_nsxv3.common.synchronization [req-bae4ff1f-f4ae-435d-b3b3-0da913c34be1 req-23ba0a21-91b1-46ed-bb71-dc9362885bfa tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 851.042177] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 851.043423] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.043522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.044155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044155] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.044155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.044155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.044553] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.065506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.065871] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.065951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.066035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.066230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.066315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.066405] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 is going to be updated. [ 851.111300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.111481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.111571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.111894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.112164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.113433] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.128099] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: IN_PROGRESS for 2s [ 851.168225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 851.168225] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 851.168225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.206979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 851.207615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.208374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.209879] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.209879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.209879] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.523969] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 851.527050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.529886] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.530145] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.530285] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.530598] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.530809] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.531042] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.531159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.531288] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.531443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.531614] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.531744] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.531857] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.531960] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.532077] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.532219] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.532301] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.549534] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.552094] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.552094] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.552094] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.553790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.553790] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.553790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.553790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.553790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.553790] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad7136a-9b0c-4bd3-be21-f43d24fe1667',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.619694] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.619838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.620497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.620497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.620497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.620497] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 851.651078] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.651078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.651078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.651078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.651078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.662752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 851.712694] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.712694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.713104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.713104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.713104] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.713245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.713288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.713412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.713503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.713593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.713790] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.713874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.713917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.714049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.714215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.714347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.714436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.714600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.714676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.714758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.714848] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.052099] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.058023] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.058023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 not found, creating... [ 852.058023] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.058023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.058891] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.058891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.058891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.058891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.058891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.058891] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 is going to be created. [ 852.084991] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.085241] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.085463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.085818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.086078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.086487] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.223881] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 852.260874] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.261217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.261650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.261971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.262141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.262141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.263015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.263015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.264259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.264607] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.264756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.264853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.265066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.265172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.265273] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be created. [ 852.385085] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.385337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.385337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.385779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.385779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.408215] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 852.442036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 852.442323] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 deletion is rescheduled due to dependency. [ 852.442486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.554877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.555104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.555824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.555824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.555824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.555824] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 852.586840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.587071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.587071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.587253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.587450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.598403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 852.803526] env[65469]: INFO networking_nsxv3.common.synchronization [req-bae4ff1f-f4ae-435d-b3b3-0da913c34be1 req-6f74511b-c951-40b6-84e2-144d5a3b031c service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 852.803705] env[65469]: INFO networking_nsxv3.common.synchronization [req-bae4ff1f-f4ae-435d-b3b3-0da913c34be1 req-6f74511b-c951-40b6-84e2-144d5a3b031c service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 852.803841] env[65469]: INFO networking_nsxv3.common.synchronization [req-bae4ff1f-f4ae-435d-b3b3-0da913c34be1 req-6f74511b-c951-40b6-84e2-144d5a3b031c service nova] Enqueued Resource ID: 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 with Priority: HIGHEST for action port [ 852.804378] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 852.804540] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 852.804641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 with Priority: HIGHEST for action port [ 852.804917] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.805175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.805286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805660] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.806566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.806671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.806928] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.807059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.807226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.807366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.807492] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad7136a-9b0c-4bd3-be21-f43d24fe1667',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.139967] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 in Status: SUCCESS [ 853.140320] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 deletion is rescheduled due to dependency. [ 853.140320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.310062] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.310248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.312027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 with status ACTIVE [ 853.312027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.312027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.312027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.312027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.312683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.312683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.312683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.312683] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ad7136a-9b0c-4bd3-be21-f43d24fe1667 is going to be updated. [ 853.337870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.338070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.338070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.338297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.338428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.338594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad7136a-9b0c-4bd3-be21-f43d24fe1667" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.641906] env[65469]: INFO networking_nsxv3.common.synchronization [req-a7b2e9c8-4082-44c0-9175-22beabaeb61a req-c1d92326-db86-408c-ab09-0bf48a62907c tempest-DeleteServersAdminTestJSON-7449079 tempest-DeleteServersAdminTestJSON-7449079-project-admin] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 853.642265] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 853.643649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.644263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.644263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.644263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.646641] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.646641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.646641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.646641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.646641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.646641] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.673587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 853.673587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.148938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.149517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.149630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.149966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.150149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.150418] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.150639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.150707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.150999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.151160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.151336] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be updated. [ 854.185372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.185501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.185653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.186453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.187157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.200836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 854.425097] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 854.425329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.609610] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 854.609610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.609610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.609610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.609610] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.609610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.609610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.610549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.610549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.610549] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.634078] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ec0d1a4a-e9fe-4948-a68e-a7c53f4b9afd None None] Enqueued Resource ID: 3dc422f5-11cf-418b-ba8b-572b672db79c with Priority: HIGHEST for action port [ 854.634735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc422f5-11cf-418b-ba8b-572b672db79c with Priority: HIGHEST for action port [ 854.635074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc422f5-11cf-418b-ba8b-572b672db79c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.635503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc422f5-11cf-418b-ba8b-572b672db79c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.635503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc422f5-11cf-418b-ba8b-572b672db79c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.635657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc422f5-11cf-418b-ba8b-572b672db79c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.635657] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc422f5-11cf-418b-ba8b-572b672db79c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.112361] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.139375] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dc422f5-11cf-418b-ba8b-572b672db79c [ 855.139548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.139685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.139685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.139933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.139990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.140075] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dc422f5-11cf-418b-ba8b-572b672db79c already deleted. [ 855.140161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc422f5-11cf-418b-ba8b-572b672db79c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.151152] env[65469]: INFO networking_nsxv3.common.synchronization [req-b56157be-14c4-47ea-a3e4-c2ac9d62fa5a req-58953716-846f-44f5-bac1-5fbef348078a tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 855.151968] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGHEST for action security_group_members [ 855.152641] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.152641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.152838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.153260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.153260] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.153610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.153925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.153925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.154193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.154413] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.615344] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.658154] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.658154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.658154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.658154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.685723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.685978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.686423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.686423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.686423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.686598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.686598] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b is going to be updated. [ 855.719801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.719801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.719801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.719801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.719801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.731424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: IN_PROGRESS for 2s [ 856.118122] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.119259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.119259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.119259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.119259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.119259] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 856.153713] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.154187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.154187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.154187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.154355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.167909] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 856.213218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 856.213445] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 deletion is rescheduled due to dependency. [ 856.213754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.711733] env[65469]: INFO networking_nsxv3.common.synchronization [req-709d9b01-8ea7-476f-813e-fbff1ead5ea6 req-98e13d28-7ff8-4a3e-8078-c6de089ebd9b tempest-ServersNegativeTestMultiTenantJSON-48958143 tempest-ServersNegativeTestMultiTenantJSON-48958143-project-member] Enqueued Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 856.712624] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 856.712877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.712987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.713041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.713278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.713439] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.713545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.713610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.713766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.713849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.713938] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.104699] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.104699] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.104916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.105689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.105689] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.105689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.105689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.105957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.105957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.108109] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.108109] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.108109] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.108109] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.108109] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.108427] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.108590] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.133319] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.133484] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.133624] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.133813] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.134158] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-d9004da8-1e52-4fc4-886c-bba418908d70 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.134333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.134454] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.134788] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.134920] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9004da8-1e52-4fc4-886c-bba418908d70',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.177246] env[65469]: INFO networking_nsxv3.common.synchronization [None req-b64e931b-cd3b-4c25-bb6a-cfea1763ef25 None None] Enqueued Resource ID: 8f09c6ad-bf9e-4040-9f86-63abf0f56d5a with Priority: HIGHEST for action port [ 857.177246] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f09c6ad-bf9e-4040-9f86-63abf0f56d5a with Priority: HIGHEST for action port [ 857.177246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f09c6ad-bf9e-4040-9f86-63abf0f56d5a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.177246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f09c6ad-bf9e-4040-9f86-63abf0f56d5a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.178265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f09c6ad-bf9e-4040-9f86-63abf0f56d5a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.178610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f09c6ad-bf9e-4040-9f86-63abf0f56d5a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.178800] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f09c6ad-bf9e-4040-9f86-63abf0f56d5a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.217527] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.217527] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.217527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.218160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.218160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 already deleted. [ 857.218160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355779] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c4f6b41-5c54-48a3-8a9d-de1160a2177f req-aaba6816-5c14-4807-809c-97c053910780 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 857.356287] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 857.356922] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.356922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.356922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.357195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.357195] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.357281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.357320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.360553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.360553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.360553] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.637728] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.638050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.638192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.638527] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.638737] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.638835] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port d9004da8-1e52-4fc4-886c-bba418908d70 not found, creating... [ 857.639125] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.639283] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.639419] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.639734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.639882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.640214] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.640372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.640490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.640753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.640925] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.641129] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: d9004da8-1e52-4fc4-886c-bba418908d70 is going to be created. [ 857.665845] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.665845] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.666048] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.666553] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.666553] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.666733] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.681729] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f09c6ad-bf9e-4040-9f86-63abf0f56d5a [ 857.681967] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.681967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.682130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.682582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.682582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.682582] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f09c6ad-bf9e-4040-9f86-63abf0f56d5a already deleted. [ 857.682582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f09c6ad-bf9e-4040-9f86-63abf0f56d5a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.744207] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b in Status: SUCCESS [ 857.744406] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b deletion is rescheduled due to dependency. [ 857.744594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.860107] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.182256] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 858.182256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.183445] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.183445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.183737] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.363941] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.463323] env[65469]: INFO networking_nsxv3.common.synchronization [req-709d9b01-8ea7-476f-813e-fbff1ead5ea6 req-4d1116fa-47cc-45da-89e4-02d8de12f47d service nova] Enqueued Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_rules [ 858.463521] env[65469]: INFO networking_nsxv3.common.synchronization [req-709d9b01-8ea7-476f-813e-fbff1ead5ea6 req-4d1116fa-47cc-45da-89e4-02d8de12f47d service nova] Enqueued Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 858.466020] env[65469]: INFO networking_nsxv3.common.synchronization [req-709d9b01-8ea7-476f-813e-fbff1ead5ea6 req-4d1116fa-47cc-45da-89e4-02d8de12f47d service nova] Enqueued Resource ID: d9004da8-1e52-4fc4-886c-bba418908d70 with Priority: HIGHEST for action port [ 858.466020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_rules [ 858.466020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 858.466020] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9004da8-1e52-4fc4-886c-bba418908d70 with Priority: HIGHEST for action port [ 858.466020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.466020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.466020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.466020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.466020] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.466974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.467204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.467383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.469114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.469114] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.469114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.469114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.469114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.469114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.469114] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.470632] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9004da8-1e52-4fc4-886c-bba418908d70 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.470791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.470791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.470957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.471041] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9004da8-1e52-4fc4-886c-bba418908d70',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.686430] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.686680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.686749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.686988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.687259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.687370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.687460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.687668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.687768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.687892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.688082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.688177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.688248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.688436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.688613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.688798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.688798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.689123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.689216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.689339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.689480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.866066] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.866318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.866419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.866679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.866755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.866887] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 858.897635] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.897981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.897981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.898107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.898186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.908375] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 858.971438] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.973496] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9004da8-1e52-4fc4-886c-bba418908d70 with status ACTIVE [ 858.973732] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.973861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.973925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.974150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.974241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.974448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.974537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.974609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.974773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.974860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.975066] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.975163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.975248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.975382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.978123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.978221] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9004da8-1e52-4fc4-886c-bba418908d70 is going to be updated. [ 858.979604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.979749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.004198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.004361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.004427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.004684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.004833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.005026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9004da8-1e52-4fc4-886c-bba418908d70" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.192424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 859.221345] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.221574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.221693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.222028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.222163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.222451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.222596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.222687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.222910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.223068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.223496] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.223496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.223640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.223799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.223911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.224228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.224369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.224466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.224683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.224796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.224926] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 859.318939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.319108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.319179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.319390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.319572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.346012] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 859.474711] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.632525] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-3434760b-1f13-44a4-b047-05262776d3ff tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 859.633528] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 859.634142] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.634468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.634678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.635056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.635359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.635626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.635843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.637863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.637863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.637863] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.964958] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-f2fe78d4-0ea7-4e29-b43a-d48f32684aaa tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 859.965880] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 859.965880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.967090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.979364] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.979611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.979683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.979848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.979935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.980043] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 is going to be created. [ 860.011027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.011027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.011027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.011293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.011741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.025649] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: UNINITIALIZED for 2s [ 860.139609] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.139958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.140023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.140340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.164444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.164676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.164814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.165796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.166112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.166213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.166368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 860.198671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.199412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.199412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.199412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.199412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.212508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 860.395635] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-4 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.395987] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.396175] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.396625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.396999] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.397319] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.397516] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.397989] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.398222] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.398628] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.398807] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.398993] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.399213] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.399340] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.399492] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.399628] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.436291] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.436511] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.436718] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.436912] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.437319] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-96188362-88b7-4cfa-aad3-400d35db5406 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.437539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.437693] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.438124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.438285] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96188362-88b7-4cfa-aad3-400d35db5406',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.921369] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 860.921369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.944252] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.944252] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 96188362-88b7-4cfa-aad3-400d35db5406 not found, creating... [ 860.944252] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.944252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.944768] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.944768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.944768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.944768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.945300] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.945651] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 96188362-88b7-4cfa-aad3-400d35db5406 is going to be created. [ 860.970916] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.970916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.970916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.970916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.970916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.970916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.362622] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 861.362622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.765838] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-1904cf7e-c839-44aa-a71a-e1a82dd29f5c service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 861.765838] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-1904cf7e-c839-44aa-a71a-e1a82dd29f5c service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 861.765838] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-1904cf7e-c839-44aa-a71a-e1a82dd29f5c service nova] Enqueued Resource ID: 96188362-88b7-4cfa-aad3-400d35db5406 with Priority: HIGHEST for action port [ 861.766704] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 861.767231] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 861.767433] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96188362-88b7-4cfa-aad3-400d35db5406 with Priority: HIGHEST for action port [ 861.767868] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.768228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.768228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.768445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.768660] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.770316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.771028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.771028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-96188362-88b7-4cfa-aad3-400d35db5406 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.771028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.771028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.771364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.771475] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96188362-88b7-4cfa-aad3-400d35db5406',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.040060] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: SUCCESS [ 862.040211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.040349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.040592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.040826] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.041317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.041317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.041317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.041477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.041477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.041570] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.232365] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 4s [ 862.275021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.275021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.275021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96188362-88b7-4cfa-aad3-400d35db5406 with status ACTIVE [ 862.275325] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.276161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.276161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.276161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.276161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.276417] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.276417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.276519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.276634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.276727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.276955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.277085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.277153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.277298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.277384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.277502] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96188362-88b7-4cfa-aad3-400d35db5406 is going to be updated. [ 862.313285] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.313285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.313285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.313285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.313285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.313285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96188362-88b7-4cfa-aad3-400d35db5406" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.543912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.544308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.544308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.544420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.544552] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.544653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.544737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.544917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.545016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.545114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.545265] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.545359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.545503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.545557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.545690] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.545785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.545853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.545979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.546067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.546150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.546241] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.592173] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.592173] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-976" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.592173] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-976" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.592547] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-976" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.592547] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.592718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.592856] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.593135] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.593372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.593628] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.593750] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.593861] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.593970] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.594090] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.594196] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.594330] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.618826] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.619029] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.619144] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.619329] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-976" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.619733] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-e2b59b39-01c6-406e-9b90-78fbbdf35517 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.619932] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.620051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.620417] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.620599] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b59b39-01c6-406e-9b90-78fbbdf35517',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.049079] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8710ede3-753e-4d9b-b6ab-3276d28c0b69: rpc.has_security_group_logging(os_id): False [ 863.071938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.071938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.071938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.071938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.071938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.072305] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.072453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.072557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.072902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.073036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.073467] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.073627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.074180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.074180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.074180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.074355] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.074457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.074546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.074747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.074856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.074978] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 is going to be created. [ 863.123565] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.126034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port e2b59b39-01c6-406e-9b90-78fbbdf35517 not found, creating... [ 863.126034] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.126034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.126689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.126689] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.126689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.126689] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.127333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.127333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.127333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: e2b59b39-01c6-406e-9b90-78fbbdf35517 is going to be created. [ 863.151095] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.151095] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.151095] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.151395] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.151649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.151879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.154939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.154939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.154939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.154939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.154939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.168505] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: IN_PROGRESS for 2s [ 863.622448] env[65469]: INFO networking_nsxv3.common.synchronization [req-c4025932-019f-4fc9-8ddd-03573ac42e5a req-3dcb30b9-733e-467b-b504-3d4767173977 tempest-ServersV294TestFqdnHostnames-1303142590 tempest-ServersV294TestFqdnHostnames-1303142590-project-member] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 863.623338] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 863.623822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.623982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.624077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.627360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.627360] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.627360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.627360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.627360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.627360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.627360] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.947626] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-2a01219c-82cb-47a4-a6c8-60c68216a4e3 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 863.947626] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-2a01219c-82cb-47a4-a6c8-60c68216a4e3 service nova] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 863.947626] env[65469]: INFO networking_nsxv3.common.synchronization [req-e536c8b8-264e-479b-8056-5af99f5506c8 req-2a01219c-82cb-47a4-a6c8-60c68216a4e3 service nova] Enqueued Resource ID: e2b59b39-01c6-406e-9b90-78fbbdf35517 with Priority: HIGHEST for action port [ 863.947626] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_rules [ 863.948071] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 863.949431] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b59b39-01c6-406e-9b90-78fbbdf35517 with Priority: HIGHEST for action port [ 863.950311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.951210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.955043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.955043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.955043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b59b39-01c6-406e-9b90-78fbbdf35517 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.955043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.955043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.955043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.955043] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b59b39-01c6-406e-9b90-78fbbdf35517',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.035187] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.035187] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-66" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.035671] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-66" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.036421] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-66" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.037096] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.037539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.037955] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.038370] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.038813] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.039170] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.039407] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.039685] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.039980] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.042621] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.042621] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.042621] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.066042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.066042] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.066042] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.066042] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-66" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.066545] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-ee47e18f-d51f-457c-901e-0a665c56e3a9 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.066674] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.066766] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.067742] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.067892] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee47e18f-d51f-457c-901e-0a665c56e3a9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.127594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.127808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.127879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.128171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.128374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.128633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.128708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.128798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.129035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.129166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.129232] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 already deleted. [ 864.129288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.248194] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 864.248194] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 deletion is rescheduled due to dependency. [ 864.248194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.248194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.248623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.248623] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.248623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.248856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.248856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.248992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.249084] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.459346] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b59b39-01c6-406e-9b90-78fbbdf35517 with status ACTIVE [ 864.459584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.459663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.459704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.461664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.461664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.461664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.461664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b59b39-01c6-406e-9b90-78fbbdf35517 is going to be updated. [ 864.490069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.490301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.490351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.490628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.490753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.491585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b59b39-01c6-406e-9b90-78fbbdf35517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.570883] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.571132] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.571244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.571546] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.571701] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.571858] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port ee47e18f-d51f-457c-901e-0a665c56e3a9 not found, creating... [ 864.572169] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.572332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.572449] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.572751] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.572945] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.573278] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.573439] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.573558] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.573837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.573975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.574134] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: ee47e18f-d51f-457c-901e-0a665c56e3a9 is going to be created. [ 864.604111] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.604342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.604521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.605113] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.605113] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.605264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.752950] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.191496] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: SUCCESS [ 865.191737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.256415] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.414047] env[65469]: INFO networking_nsxv3.common.synchronization [req-c4025932-019f-4fc9-8ddd-03573ac42e5a req-e569def9-dd78-48de-9d9c-10e89b3a988a service nova] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 865.414209] env[65469]: INFO networking_nsxv3.common.synchronization [req-c4025932-019f-4fc9-8ddd-03573ac42e5a req-e569def9-dd78-48de-9d9c-10e89b3a988a service nova] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 865.414358] env[65469]: INFO networking_nsxv3.common.synchronization [req-c4025932-019f-4fc9-8ddd-03573ac42e5a req-e569def9-dd78-48de-9d9c-10e89b3a988a service nova] Enqueued Resource ID: ee47e18f-d51f-457c-901e-0a665c56e3a9 with Priority: HIGHEST for action port [ 865.415421] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_rules [ 865.415649] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 865.415736] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee47e18f-d51f-457c-901e-0a665c56e3a9 with Priority: HIGHEST for action port [ 865.416027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.416225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.416333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.416559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.416559] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.417739] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.417929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.418259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.418551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.418792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.418979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.419191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.419334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.419754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.419754] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.422389] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee47e18f-d51f-457c-901e-0a665c56e3a9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.422389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.422389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.422389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.422389] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee47e18f-d51f-457c-901e-0a665c56e3a9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.758444] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.758982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.758982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.759251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.759313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.759426] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 865.791933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.792176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.792270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.792526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.792712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.802702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 865.924499] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.924690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.924877] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.925875] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee47e18f-d51f-457c-901e-0a665c56e3a9 with status ACTIVE [ 865.926796] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.926796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.926796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.926796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.926796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.927485] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.928661] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.928661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.929144] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee47e18f-d51f-457c-901e-0a665c56e3a9 is going to be updated. [ 865.956212] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.956350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.956441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.956664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.956811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.956984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee47e18f-d51f-457c-901e-0a665c56e3a9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.305795] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 866.305960] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 866.306894] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 866.307071] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 866.307713] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1106b20d-94db-4783-8d93-650350b76b8a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.307713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.307713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.308112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.308112] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.308112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.308112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.308331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.308395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.308502] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.309427] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.309564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.309564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.309732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.309932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.310082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.310143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.310366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.310478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.310582] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.366301] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 866.366484] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 866.366621] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_rules [ 866.366784] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 866.366915] env[65469]: INFO networking_nsxv3.common.synchronization [req-a28af387-fd94-4871-9159-21a2de05b51d req-db0b26e3-91d3-48f6-ad55-e9842d66f5ad tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 866.367440] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 866.367719] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_rules [ 866.367850] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 866.367980] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 866.372231] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 866.373436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.373670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.374055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.374128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.374267] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.376829] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1106b20d-94db-4783-8d93-650350b76b8a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.377062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.377184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.377573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.377719] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.381934] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-06785ac4-1625-41d1-a882-284a7be309fc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.382147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.382217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.383935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.383935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06785ac4-1625-41d1-a882-284a7be309fc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.383935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.383935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.384454] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1106b20d-94db-4783-8d93-650350b76b8a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.384536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.431190] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.812384] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.815927] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.888511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.888511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.888511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1106b20d-94db-4783-8d93-650350b76b8a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.888511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.888511] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06785ac4-1625-41d1-a882-284a7be309fc with status ACTIVE [ 866.888511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.888511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.888511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.888511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.889697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.889697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.889697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.890227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.890375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.890912] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06785ac4-1625-41d1-a882-284a7be309fc is going to be updated. [ 866.912215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.912866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.912866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.912866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.912866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.913068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.933645] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.934461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.934461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.934461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.934461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.934998] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 is going to be created. [ 866.971379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.971549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.971612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.971861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.972065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.984957] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: UNINITIALIZED for 2s [ 867.007089] env[65469]: INFO networking_nsxv3.common.synchronization [req-c66764f4-e1a9-4096-8d81-e3ef3b12f3cf req-7fb83b44-fcf3-4cea-9ee5-347561974450 tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 867.007399] env[65469]: INFO networking_nsxv3.common.synchronization [req-c66764f4-e1a9-4096-8d81-e3ef3b12f3cf req-7fb83b44-fcf3-4cea-9ee5-347561974450 tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 867.008183] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1106b20d-94db-4783-8d93-650350b76b8a with Priority: HIGHEST for action security_group_members [ 867.008336] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 867.008649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1106b20d-94db-4783-8d93-650350b76b8a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.008754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.008958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.009055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.065463] env[65469]: INFO networking_nsxv3.common.synchronization [req-c66764f4-e1a9-4096-8d81-e3ef3b12f3cf req-7fb83b44-fcf3-4cea-9ee5-347561974450 tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 867.065836] env[65469]: INFO networking_nsxv3.common.synchronization [req-c66764f4-e1a9-4096-8d81-e3ef3b12f3cf req-7fb83b44-fcf3-4cea-9ee5-347561974450 tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 867.067161] env[65469]: INFO networking_nsxv3.common.synchronization [req-c66764f4-e1a9-4096-8d81-e3ef3b12f3cf req-7fb83b44-fcf3-4cea-9ee5-347561974450 tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 867.067161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_rules [ 867.067161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 867.067161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06785ac4-1625-41d1-a882-284a7be309fc with Priority: HIGHEST for action port [ 867.067819] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.067819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.068081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.068181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.068414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-06785ac4-1625-41d1-a882-284a7be309fc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.068631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.068752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.069604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.069704] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06785ac4-1625-41d1-a882-284a7be309fc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.317018] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.318277] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.571891] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06785ac4-1625-41d1-a882-284a7be309fc with status ACTIVE [ 867.572098] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.572806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.572806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.572957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.573385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.573951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.574020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.574414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.574531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.574805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.574959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.575069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.575252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.575399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.575458] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06785ac4-1625-41d1-a882-284a7be309fc is going to be updated. [ 867.599741] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.599741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.600050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.600098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.600339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.600427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06785ac4-1625-41d1-a882-284a7be309fc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.812991] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 867.813425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.813425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.813667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.813866] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.813995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.814083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.814210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.814288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.814379] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.820190] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.820324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.820831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.820831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.820831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.820831] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1106b20d-94db-4783-8d93-650350b76b8a is going to be created. [ 867.822070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.822177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.822259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.822414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.822492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.822579] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 867.850441] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.850624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.850673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.850920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.851141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.853070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.853152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.853222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.853400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.853588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.865214] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 867.865992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1106b20d-94db-4783-8d93-650350b76b8a in Status: UNINITIALIZED for 2s [ 868.316796] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.782262] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c6ab04e-2276-43fc-b51e-1cc7ae7c9c6c req-66394c5a-6b3e-42ef-ac7a-60cb3414c0f1 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 868.782803] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 868.786405] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.786703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.786846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.789347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.789695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.789834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.789899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.790133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.790207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.790441] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.822293] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.998535] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: SUCCESS [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.998535] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998535] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.098718] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.098930] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.099051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.099314] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.099629] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.099975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.099975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.100202] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.100348] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.100576] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.100794] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.100929] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.100999] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.101119] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.101225] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.101387] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.126613] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.126786] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.126922] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.127160] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.127423] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-a4bf1d28-bea1-4a57-b5a7-04285f55c873 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.127754] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.127916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.128270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.128411] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4bf1d28-bea1-4a57-b5a7-04285f55c873',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.292724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.292907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.292958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.293177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.293267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.293472] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.293582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.293660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.294148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.294148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.294148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 already deleted. [ 869.294148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.324943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.325160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.325160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.325363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.325482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.325550] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 869.356453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.356453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.356593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.356766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.356959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.368476] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 869.499952] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.631933] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.632258] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.635709] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port a4bf1d28-bea1-4a57-b5a7-04285f55c873 not found, creating... [ 869.635709] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.635709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.635709] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.636371] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.636371] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.636371] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.636371] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.637078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: a4bf1d28-bea1-4a57-b5a7-04285f55c873 is going to be created. [ 869.659587] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.660089] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.660304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.660679] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.661021] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.661726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.876915] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1106b20d-94db-4783-8d93-650350b76b8a in Status: SUCCESS [ 869.877490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.877490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.878010] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.878115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.878209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.878277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.878488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.878620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.878746] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.881198] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 869.881507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.881756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.882277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.882364] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.882493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.882590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.882802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.882923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.883306] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.002600] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5be86bbb-df18-464c-9cd6-f07241444961: rpc.has_security_group_logging(os_id): False [ 870.030072] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.031985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.031985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.032315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.032470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.032961] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.033214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.033338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.033783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.034046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.034130] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 is going to be created. [ 870.112905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.113190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.113190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.113404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.113630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.126478] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: IN_PROGRESS for 2s [ 870.385700] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.385884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.385949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.386231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.386355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.386643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.386707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.386813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.386939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.387033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.387124] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1106b20d-94db-4783-8d93-650350b76b8a is going to be deleted. [ 870.388277] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.421635] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c6ab04e-2276-43fc-b51e-1cc7ae7c9c6c req-2254f84b-9920-41e8-83b7-0553de7c27a9 service nova] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 870.421841] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c6ab04e-2276-43fc-b51e-1cc7ae7c9c6c req-2254f84b-9920-41e8-83b7-0553de7c27a9 service nova] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 870.422052] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c6ab04e-2276-43fc-b51e-1cc7ae7c9c6c req-2254f84b-9920-41e8-83b7-0553de7c27a9 service nova] Enqueued Resource ID: a4bf1d28-bea1-4a57-b5a7-04285f55c873 with Priority: HIGHEST for action port [ 870.422592] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_rules [ 870.422681] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 870.422783] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4bf1d28-bea1-4a57-b5a7-04285f55c873 with Priority: HIGHEST for action port [ 870.423077] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.423208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.423275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.423480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.423563] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.426780] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.426780] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.426780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.426780] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.427474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4bf1d28-bea1-4a57-b5a7-04285f55c873 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.429808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.429808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.429808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.429808] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4bf1d28-bea1-4a57-b5a7-04285f55c873',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.441255] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.441501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.441501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.441761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.441858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.441957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.442128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.442358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.442475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.442593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.442661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.442808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.442887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.442984] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.660786] env[65469]: INFO networking_nsxv3.common.synchronization [req-d35edc53-983d-46e4-a8f4-3cdb08a8b8a2 req-5382e148-eb66-4e68-9559-12417f040d21 tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 870.661785] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 870.661785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.661785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.662052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.662220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.662398] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.662500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.662560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.662730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.662812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.662905] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.891826] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.928696] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.929658] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.929782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.929946] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4bf1d28-bea1-4a57-b5a7-04285f55c873 with status ACTIVE [ 870.930191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.930303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.930371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.930600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.930665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.930854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.930926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.930982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.931138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.931214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.931421] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.931514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.931575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.933013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.933013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.933013] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4bf1d28-bea1-4a57-b5a7-04285f55c873 is going to be updated. [ 870.946198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.948551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.948551] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1106b20d-94db-4783-8d93-650350b76b8a already deleted. [ 870.948551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.948551] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.949280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.949280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.949280] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.949280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.949280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.949597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.949597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.949597] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.954761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.954891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.955861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.955861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.955861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.955861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4bf1d28-bea1-4a57-b5a7-04285f55c873" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.165896] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.380754] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 871.381043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.381210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.381437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.381642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.381802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.381986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.382061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.382145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.382237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.382343] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.383309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.383544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.383839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.383963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.384052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.384193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.384283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.384414] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.394241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.394486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.395019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.395019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.395210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.395512] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 871.435384] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.449715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.449930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.449978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.451050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.451050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.451879] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1106b20d-94db-4783-8d93-650350b76b8a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.452883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.453048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.453125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.453288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.453392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.453627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.453771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.453771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.453906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.453965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.454095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1106b20d-94db-4783-8d93-650350b76b8a already deleted. [ 871.454167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.471190] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 871.621068] env[65469]: INFO networking_nsxv3.common.synchronization [req-43b36ed7-ee1e-4f68-8873-7ee99ade7e8a req-91607f66-4bb0-4a67-a1b3-4c5cbbe5ee41 tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 871.624259] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 871.624761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.624926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.625029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.625376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.625571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.625838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.625838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.626427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.626427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.626427] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.668466] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.886665] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.888675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.888815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.938207] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.938678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.938678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.938678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.938837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.938837] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 is going to be created. [ 871.955653] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1106b20d-94db-4783-8d93-650350b76b8a: rpc.has_security_group_logging(os_id): False [ 871.976573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.976840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.976840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.977116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.977188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.977362] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.977469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.977534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.977692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.977770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.977860] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1106b20d-94db-4783-8d93-650350b76b8a is going to be created. [ 871.979871] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.980022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.980771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.980771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.980928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.999292] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: UNINITIALIZED for 2s [ 872.003557] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a], does not exist path=[/infra/domains/default/groups/1106b20d-94db-4783-8d93-650350b76b8a]."\n}' [ 872.003730] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1106b20d-94db-4783-8d93-650350b76b8a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a [ 872.003788] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 872.069993] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-995 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.070342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.070430] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.070704] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.071149] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.071376] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.071576] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.071814] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.071961] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.072186] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.072299] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.072405] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.072511] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.072613] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.072754] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.072911] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.125304] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.125304] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.125304] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.125304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-995" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.125304] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-5d198c10-8194-4972-a91b-d8f5b8570aa2 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.125304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.125304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.125304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.125304] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d198c10-8194-4972-a91b-d8f5b8570aa2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.131037] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.131037] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.131037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.131037] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be updated. [ 872.147038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.147038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.147038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.147038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.147706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.148141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.148509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.148736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.149101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.149315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.149642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.149976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.150160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.150415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.150599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.151230] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1106b20d-94db-4783-8d93-650350b76b8a is going to be created. [ 872.152994] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: SUCCESS [ 872.153217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.171327] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.171530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.171530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.171740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.171954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.173138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.173262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.173317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.173484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.173568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.173657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 872.175360] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a], does not exist path=[/infra/domains/default/groups/1106b20d-94db-4783-8d93-650350b76b8a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a [ 872.175502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1106b20d-94db-4783-8d93-650350b76b8a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.175669] env[65469]: Traceback (most recent call last): [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 872.175729] env[65469]: return func(*args, **kwargs) [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 872.175729] env[65469]: res.raise_for_status() [ 872.175729] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 872.175729] env[65469]: raise HTTPError(http_error_msg, response=self) [ 872.175729] env[65469]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a [ 872.175729] env[65469]: During handling of the above exception, another exception occurred: [ 872.175729] env[65469]: Traceback (most recent call last): [ 872.175729] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 872.175729] env[65469]: listener.cb(fileno) [ 872.175729] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 872.175729] env[65469]: result = function(*args, **kwargs) [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 872.175729] env[65469]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 872.175729] env[65469]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 872.175729] env[65469]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 872.175729] env[65469]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 872.175729] env[65469]: res.raise_for_status() [ 872.175729] env[65469]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 872.175729] env[65469]: raise HTTPError(http_error_msg, response=self) [ 872.175729] env[65469]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1106b20d-94db-4783-8d93-650350b76b8a [ 872.175729] env[65469]: Removing descriptor: 18 [ 872.191335] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 872.207236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.207681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.207681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.207854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.208328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.221255] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 872.389864] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.629815] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.630106] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.630177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.630481] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.630666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.630778] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 5d198c10-8194-4972-a91b-d8f5b8570aa2 not found, creating... [ 872.631107] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.631323] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.631453] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.631796] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.631983] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.632322] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.632475] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.632591] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.632817] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.632933] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.633318] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 5d198c10-8194-4972-a91b-d8f5b8570aa2 is going to be created. [ 872.662360] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.662568] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.662688] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.662970] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.663233] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.663457] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.669665] env[65469]: INFO networking_nsxv3.common.synchronization [req-1cc0f378-6d25-4e05-8ef2-f9e0639c82e9 req-5bf4d074-995f-4e1d-8017-09409a810fdc tempest-ServersTestJSON-1003188530 tempest-ServersTestJSON-1003188530-project-member] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 872.669665] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGHEST for action security_group_members [ 872.669665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.669665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.669665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.669665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.670086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.670086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.670086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.671052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.671052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.671052] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.892424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.892776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.892776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.893026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.893026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.893112] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 872.926200] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.926489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.926489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.926733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.928708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.939447] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 873.174729] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.174729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.174729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.174729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.202377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.204228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.204228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.204228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.204228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.204228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.204228] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb is going to be updated. [ 873.239812] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.239812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.239812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.240186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.240186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.259642] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: IN_PROGRESS for 2s [ 873.431420] env[65469]: INFO networking_nsxv3.common.synchronization [req-43b36ed7-ee1e-4f68-8873-7ee99ade7e8a req-c01828ef-0a3c-4ab5-a37e-f86af12eb9e0 service nova] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 873.431609] env[65469]: INFO networking_nsxv3.common.synchronization [req-43b36ed7-ee1e-4f68-8873-7ee99ade7e8a req-c01828ef-0a3c-4ab5-a37e-f86af12eb9e0 service nova] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 873.431749] env[65469]: INFO networking_nsxv3.common.synchronization [req-43b36ed7-ee1e-4f68-8873-7ee99ade7e8a req-c01828ef-0a3c-4ab5-a37e-f86af12eb9e0 service nova] Enqueued Resource ID: 5d198c10-8194-4972-a91b-d8f5b8570aa2 with Priority: HIGHEST for action port [ 873.432345] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_rules [ 873.432487] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 873.432585] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d198c10-8194-4972-a91b-d8f5b8570aa2 with Priority: HIGHEST for action port [ 873.432885] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.433015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.433369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.433600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.433723] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.435353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.435461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.435675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d198c10-8194-4972-a91b-d8f5b8570aa2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.435783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.435846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.436073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.436110] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d198c10-8194-4972-a91b-d8f5b8570aa2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.486181] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 873.486416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.486597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.486828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.487031] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.487884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.487884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.488036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.488267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.489943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.489943] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.490311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.490472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.490887] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.490887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.490887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.491230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.491230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.491359] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.941582] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.942655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.942655] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d198c10-8194-4972-a91b-d8f5b8570aa2 with status ACTIVE [ 873.942655] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.942655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.942655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.942655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.942655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.942875] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.942929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.942968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.943134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.943230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.943415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.944036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.944036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.944036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.944036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.944036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d198c10-8194-4972-a91b-d8f5b8570aa2 is going to be updated. [ 873.967548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.967761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.967761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.968083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.968230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.968668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d198c10-8194-4972-a91b-d8f5b8570aa2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.991105] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.991241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.993571] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.014168] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: SUCCESS [ 874.014255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.015032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.015157] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.015220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.015246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.015399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.015482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015653] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.206614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 4s [ 874.231937] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 4s [ 874.498737] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.517693] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.949637] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 874.949931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.950274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.950343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.950494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.950618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.950665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.950816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.950897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.950980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.951151] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.951244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.951420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.951471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.951571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.951659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.951716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.952017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.952094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.952174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.953035] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.002046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.002219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.002295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.002509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.002600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.002701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 875.020531] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc44b284-72eb-4124-9f75-2904f61a5e37: rpc.has_security_group_logging(os_id): False [ 875.043153] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.043724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.043724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.043724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.043724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.044015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.044212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.044300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.044742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.044883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.045181] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 is going to be created. [ 875.047483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.047569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.047773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.047969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.048137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.060393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 875.119347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.119538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.119635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.119814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.120011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.133984] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: IN_PROGRESS for 2s [ 875.270340] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb in Status: SUCCESS [ 875.270971] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb deletion is rescheduled due to dependency. [ 875.270971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.455119] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d3a53e0-bc08-4699-b179-a2a446524a23: rpc.has_security_group_logging(os_id): False [ 875.480243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.480449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.480552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.481106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.505645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.505964] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.507269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.507396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.507684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.507788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.508041] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.508219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.508219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.508448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.508516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.508713] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.508828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.508871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.509044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.509109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.509194] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 875.598001] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.598001] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.598001] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.598001] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.598190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.625961] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 876.222677] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 876.222677] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 deletion is rescheduled due to dependency. [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.222677] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.222677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.222677] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.241789] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 876.241789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.728982] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.837346] env[65469]: INFO networking_nsxv3.common.synchronization [req-e5754e65-ce4b-41c6-83c9-16dfee161128 req-e3f53cc6-5716-47de-9b80-cdc97500bbf7 tempest-ServersNegativeTestMultiTenantJSON-48958143 tempest-ServersNegativeTestMultiTenantJSON-48958143-project-member] Enqueued Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 876.837983] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGHEST for action security_group_members [ 876.838341] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.838480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.838549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.838751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.838903] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.839021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.839060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.839236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.839314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.839422] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.072890] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 877.073279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.073586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.073878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.074375] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.074375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.074375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.074545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.074982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.075122] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.154291] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: SUCCESS [ 877.155068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.232457] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.343978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.344227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.344227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.344981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.368357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.368796] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.368970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.369155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.369795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.369961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.370191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 is going to be updated. [ 877.427377] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.427601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.427713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.428009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.428212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.442180] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: IN_PROGRESS for 2s [ 877.579436] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.651308] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 877.651660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.651942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.652204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.652365] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.737590] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.738129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.738129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.738437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.738437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.738437] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be updated. [ 877.778062] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.778635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.778635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.778635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.778973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.789914] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 878.082465] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.154561] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.154842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.154970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.155291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.155527] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.155663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.155803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.159301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.159452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.159596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.159753] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.180044] env[65469]: INFO networking_nsxv3.common.synchronization [req-0501e36b-d646-44bb-a2c1-af284139305a req-af66b7ce-1dad-473d-87fc-ab70c6ffb7a7 tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 878.181036] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 878.181036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.181252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.181252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.181473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.181650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.181785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.181866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.182081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.182203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.182327] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.483607] env[65469]: INFO networking_nsxv3.common.synchronization [req-0501e36b-d646-44bb-a2c1-af284139305a req-5b0fecb5-430d-4282-8951-3453cf345a72 tempest-ServersTestMultiNic-865928131 tempest-ServersTestMultiNic-865928131-project-member] Enqueued Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 878.484009] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 with Priority: HIGHEST for action security_group_members [ 878.484328] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.484431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.569023] env[65469]: INFO networking_nsxv3.common.synchronization [req-adc48cd9-2081-4de3-8b7a-ed718ef3bcee req-6a9f9816-addc-4ef7-a523-f22b60247d2b tempest-ServerRescueTestJSONUnderV235-471207659 tempest-ServerRescueTestJSONUnderV235-471207659-project-member] Enqueued Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 878.569023] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 with Priority: HIGHEST for action security_group_members [ 878.569315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.569565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.587735] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.587735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.587735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.587735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.587735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.587735] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 878.626601] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.626601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.626601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.627548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.627548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.636839] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 878.664521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.664521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.685141] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.186618] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.458946] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 in Status: SUCCESS [ 879.458946] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 deletion is rescheduled due to dependency. [ 879.458946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.690361] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.690361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.690707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.690707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.690707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.690806] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 879.719667] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.719837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.719908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.720127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.720267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.731032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 879.806690] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 879.807053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.807324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.807692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.808065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.808202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.808282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.808466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.808563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.808663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.808774] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.310977] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.651183] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 880.651536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.651812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.652208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.652434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.652653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.652725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.652968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.653130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.653271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.653532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.653774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.653774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.653967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.654220] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.654372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.654468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.654774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.654826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.654965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.655167] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.657599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.657599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.657599] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.657599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.657599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.657807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.657807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.657950] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.814445] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 641bf348-fb8f-499f-a944-4cb315e55733: rpc.has_security_group_logging(os_id): False [ 880.833752] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.833989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.834121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.834296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.857030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.857030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.857172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.857172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.857394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.857484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.857576] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be updated. [ 880.926733] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.926733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.926733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.927030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.927176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.943260] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 881.161103] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.161268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.161342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.161573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.162815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b750a3b-8e4a-4042-b72c-957a6d79cdc8: rpc.has_security_group_logging(os_id): False [ 881.182708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.182837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.187311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.187311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.187311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.187311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.187311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.187311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.187801] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 881.189252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.189252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.189252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.189744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.189744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.189744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.189867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.189959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.190156] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.190270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.190334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.190516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.190596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.190843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.190945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.191022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.191178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.191256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.191333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be updated. [ 881.222685] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.222950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.223046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.223255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.223416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.237078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 881.276950] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.278529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.278529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.278529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.278529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.297619] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: IN_PROGRESS for 2s [ 881.741794] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 881.742372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.742558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.742780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.742976] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.743101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.743167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.743347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.743412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.743509] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.811411] env[65469]: INFO networking_nsxv3.common.synchronization [req-8f1b8a26-c2f6-4d80-933b-28fc2db2af8e req-bb829849-e447-4de8-b205-0d81698f94f0 tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 881.811966] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 881.812325] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.812446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.812513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.812709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.812870] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.812951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.813335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.813560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.813687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.813813] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.117141] env[65469]: INFO networking_nsxv3.common.synchronization [req-32df1f82-189a-4408-8128-397b79ab3adf req-bc22734d-2d5f-473c-8faa-33e279dd0041 tempest-ListServersNegativeTestJSON-1629459299 tempest-ListServersNegativeTestJSON-1629459299-project-member] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 882.117141] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGHEST for action security_group_members [ 882.117141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.117141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.246703] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.246904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.248086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.248258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.248300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.248504] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.249476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.249580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.249789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.249880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.249977] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 882.281099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.281251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.281314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.281538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.281672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.295101] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 882.316598] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.820964] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.957452] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 882.957866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.251616] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 883.251922] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 deletion is rescheduled due to dependency. [ 883.251967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.315047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 in Status: SUCCESS [ 883.317017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.317017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.317017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.317017] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b750a3b-8e4a-4042-b72c-957a6d79cdc8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.324211] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.324362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.324419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.324616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.324697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.326294] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 883.367961] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.368709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.368709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.368709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.368709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.379425] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 883.838797] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.839030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.839105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.839323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.839680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.839680] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b750a3b-8e4a-4042-b72c-957a6d79cdc8 is going to be deleted. [ 883.893608] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.893608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.893608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.893608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.893608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.893608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b750a3b-8e4a-4042-b72c-957a6d79cdc8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.309592] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 884.310066] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 deletion is rescheduled due to dependency. [ 884.310066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.310212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.310341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.310522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.310641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.310706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.310881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.310963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312129] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d3a53e0-bc08-4699-b179-a2a446524a23 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.312129] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312129] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d3a53e0-bc08-4699-b179-a2a446524a23',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.814982] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d3a53e0-bc08-4699-b179-a2a446524a23: rpc.has_security_group_logging(os_id): False [ 884.833614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.833750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.833818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.834114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.834181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.834335] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.834427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.834556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.834736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.834806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.835182] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.835277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.835353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.835603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.835603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.835785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.835874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.835933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.836081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.836149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.836231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 is going to be updated. [ 884.899864] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.900088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.900145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.900399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.900613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.919158] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: IN_PROGRESS for 2s [ 885.181535] env[65469]: INFO networking_nsxv3.common.synchronization [req-dde62a8e-ae18-4d98-8e22-9d5288241327 req-b8b63aa9-928c-49b1-af32-7111e568c963 tempest-ServerRescueTestJSON-1121830031 tempest-ServerRescueTestJSON-1121830031-project-member] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 885.182682] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 885.183121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.183262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.183342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.183617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.183773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.183883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.183950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.184135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.184376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.184479] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.391057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 885.391334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.392254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.392254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.392254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.392254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.392254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.392254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.392724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.392724] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.649415] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.649868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.649868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.650121] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.650379] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.650531] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.650647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.650969] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.651132] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.651334] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.651448] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.651557] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.651663] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.651776] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.651881] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.652054] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.670061] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.670235] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.670371] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.670542] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.670887] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-2b1121bb-2aad-4add-bbb0-3a2a93b64561 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.671204] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.671529] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671721] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1121bb-2aad-4add-bbb0-3a2a93b64561',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.686479] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.686791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.686791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.687156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.687156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.687265] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.687353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.687353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.687502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.687553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.687669] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e already deleted. [ 885.687715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.807032] env[65469]: INFO networking_nsxv3.common.synchronization [req-6076503c-995b-41ce-b16f-0d375be96c24 req-f437aa58-ae3f-4aba-8629-20a951c0bc94 tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 885.807567] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 885.807924] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.808061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.808129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.808326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.808628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.808628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.808628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.808854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.808854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.809135] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.895876] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.896045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.896119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.896537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.918256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.918566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.918728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.918828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.919081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.919218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.919352] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be updated. [ 885.951317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.951486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.951557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.951797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.951997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.961748] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: IN_PROGRESS for 2s [ 886.174368] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.174605] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.174752] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.175052] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.175205] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.175355] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 2b1121bb-2aad-4add-bbb0-3a2a93b64561 not found, creating... [ 886.175606] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.175759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.175880] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.176116] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.176256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.176564] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.176720] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.176839] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.177051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.177184] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.177321] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 2b1121bb-2aad-4add-bbb0-3a2a93b64561 is going to be created. [ 886.196994] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.197258] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.197387] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.197872] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.198142] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.198394] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.311422] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.815015] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.897488] env[65469]: INFO networking_nsxv3.common.synchronization [req-dde62a8e-ae18-4d98-8e22-9d5288241327 req-d3b818f6-390d-451c-85e0-6bcdd7f021f4 service nova] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_rules [ 886.897488] env[65469]: INFO networking_nsxv3.common.synchronization [req-dde62a8e-ae18-4d98-8e22-9d5288241327 req-d3b818f6-390d-451c-85e0-6bcdd7f021f4 service nova] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 886.897488] env[65469]: INFO networking_nsxv3.common.synchronization [req-dde62a8e-ae18-4d98-8e22-9d5288241327 req-d3b818f6-390d-451c-85e0-6bcdd7f021f4 service nova] Enqueued Resource ID: 2b1121bb-2aad-4add-bbb0-3a2a93b64561 with Priority: HIGHEST for action port [ 886.897488] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_rules [ 886.897488] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 886.899524] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1121bb-2aad-4add-bbb0-3a2a93b64561 with Priority: HIGHEST for action port [ 886.899524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.899764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.899927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.900291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.900471] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.901804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.901804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.901804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.901804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.902256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.902833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.902833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.902833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.902833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.902833] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.906132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1121bb-2aad-4add-bbb0-3a2a93b64561 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.906368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.906507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.907388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.907388] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1121bb-2aad-4add-bbb0-3a2a93b64561',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.935022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d3a53e0-bc08-4699-b179-a2a446524a23 in Status: SUCCESS [ 886.935247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d3a53e0-bc08-4699-b179-a2a446524a23" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.317499] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.317660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.317759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.317991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.318100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.318201] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 887.350317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.350317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.350317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.350317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.350317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.363408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 887.409071] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.412495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.412495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b1121bb-2aad-4add-bbb0-3a2a93b64561 with status ACTIVE [ 887.412495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.412495] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.412495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.414010] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.414220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.414500] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.414728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.414892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.415559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.415725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.416497] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b1121bb-2aad-4add-bbb0-3a2a93b64561 is going to be updated. [ 887.437725] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.438046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.438206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.438510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.438750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.439029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1121bb-2aad-4add-bbb0-3a2a93b64561" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.918961] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.972769] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93250c38-ef03-4516-b959-0aa8baeef74a in Status: SUCCESS [ 887.972965] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a deletion is rescheduled due to dependency. [ 887.973099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.421302] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.421484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.421554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.421785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.421881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.421980] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be created. [ 888.446352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.446514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.446555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.446764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.446921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.457896] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: UNINITIALIZED for 2s [ 889.373594] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 889.373902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.118053] env[65469]: INFO networking_nsxv3.common.synchronization [req-4dc67fc3-9731-43c7-a8a8-2578792e798d req-f4c093d6-310e-4374-9d04-4d93a95f9ea6 tempest-ListImageFiltersTestJSON-1904470615 tempest-ListImageFiltersTestJSON-1904470615-project-member] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 890.119398] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGHEST for action security_group_members [ 890.119398] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.119398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.119398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.119398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.119900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.119900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.119900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.119900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.120095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.120133] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.470286] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 890.470562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.470782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.471018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.471280] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.471450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.471544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.471751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.471863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.471974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.472126] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.622191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.622390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.622460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.622699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.643233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.643626] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.643830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.643902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.644171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.644268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.644374] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be updated. [ 890.672121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.672348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.672449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.672723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.673486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.683449] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: IN_PROGRESS for 2s [ 890.974738] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.974738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.974738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.975012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.975193] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.975302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.975374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.975690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.975690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.975690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.975855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.977539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.977539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.977539] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.482638] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc2d080-06d1-43db-887c-b69e9dc7db6e: rpc.has_security_group_logging(os_id): False [ 891.505940] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.506139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.506204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.506374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.506466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.506675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.506773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.506833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.507024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.507110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.507293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.507376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.507440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.507575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.507648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.507875] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.507972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.508049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.508192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.508265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.508348] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be created. [ 891.568681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.568681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.568681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.568681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.568864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.579836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 892.127881] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee1ca1ec-7df8-4fb5-a478-d3cc010ff79c req-bd9ae5ca-6089-4490-9504-6001d382fbe6 tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 892.129301] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 892.129641] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.129816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.129899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.130121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.130293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.130440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.130511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.130674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.130792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.130933] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.524043] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.524043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.524043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.524043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.524524] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.524592] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.524761] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.524995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.525194] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.525453] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.525589] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.525727] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.525862] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.526011] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.526151] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.526334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.547081] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.547357] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.547510] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.547690] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-211" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.548096] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-c3a7479c-c463-4f50-9bba-8e87daf32190 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.548289] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.548409] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.548739] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.548878] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3a7479c-c463-4f50-9bba-8e87daf32190',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.633048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.693034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 in Status: SUCCESS [ 892.693241] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 deletion is rescheduled due to dependency. [ 892.693359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.055189] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.055385] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.055503] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.055837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.055999] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.056171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port c3a7479c-c463-4f50-9bba-8e87daf32190 not found, creating... [ 893.056456] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.056631] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.056727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.056948] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.057106] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.057385] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.057539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.057776] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.057977] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.058062] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.058187] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: c3a7479c-c463-4f50-9bba-8e87daf32190 is going to be created. [ 893.080021] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.080270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.080363] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.080647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.080892] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.081139] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.135859] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.593152] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 893.593439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.638670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.638670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.638670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.638934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.639031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.639151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 893.667169] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.667374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.667472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.667778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.667978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.678218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 893.814998] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee1ca1ec-7df8-4fb5-a478-d3cc010ff79c req-86d6dbf4-c2ac-414d-a5d1-c869fa2d1353 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 893.814998] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee1ca1ec-7df8-4fb5-a478-d3cc010ff79c req-86d6dbf4-c2ac-414d-a5d1-c869fa2d1353 service nova] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 893.814998] env[65469]: INFO networking_nsxv3.common.synchronization [req-ee1ca1ec-7df8-4fb5-a478-d3cc010ff79c req-86d6dbf4-c2ac-414d-a5d1-c869fa2d1353 service nova] Enqueued Resource ID: c3a7479c-c463-4f50-9bba-8e87daf32190 with Priority: HIGHEST for action port [ 893.815266] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_rules [ 893.815266] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 893.815266] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a7479c-c463-4f50-9bba-8e87daf32190 with Priority: HIGHEST for action port [ 893.815548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.815665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.815725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.815963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.815998] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.818041] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.818157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.818439] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3a7479c-c463-4f50-9bba-8e87daf32190 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.818598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.818659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.818853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.818934] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3a7479c-c463-4f50-9bba-8e87daf32190',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.322669] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3a7479c-c463-4f50-9bba-8e87daf32190 with status ACTIVE [ 894.322669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.322669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.322669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.323027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.323027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.324024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.324024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.324024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.324320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.324320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.324472] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3a7479c-c463-4f50-9bba-8e87daf32190 is going to be updated. [ 894.325808] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.325987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.347305] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.347486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.347565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.347884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.348485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.348485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3a7479c-c463-4f50-9bba-8e87daf32190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.081634] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.081981] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.081981] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.082255] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.082878] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.083066] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.083191] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.083415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.083560] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.083764] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.083890] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.084009] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.084119] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.084226] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.084329] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.084459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.102701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.102891] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.103021] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.103206] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-606" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.103518] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-d295366b-068f-4aa2-b950-1e6c682e7506 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.103684] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.103801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.104069] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.104207] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d295366b-068f-4aa2-b950-1e6c682e7506',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.606486] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.606750] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.606895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.607195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.607344] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.607630] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.607791] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.607908] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.608134] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.608268] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.608559] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.608713] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.608828] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.609868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.611767] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.611767] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: d295366b-068f-4aa2-b950-1e6c682e7506 is going to be updated. [ 895.632162] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.632493] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.632493] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.632776] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.632975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.633211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.695227] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 895.695490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.695667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.695893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.696106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.696230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.696296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.696450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.696527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.696620] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.198811] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.366424] env[65469]: INFO networking_nsxv3.common.synchronization [req-5a6d4651-18c0-431d-9055-09ca1ace5cfb req-a3b5bf0d-c2b4-41f0-8313-499c3e6b4e80 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 896.366611] env[65469]: INFO networking_nsxv3.common.synchronization [req-5a6d4651-18c0-431d-9055-09ca1ace5cfb req-a3b5bf0d-c2b4-41f0-8313-499c3e6b4e80 service nova] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 896.366751] env[65469]: INFO networking_nsxv3.common.synchronization [req-5a6d4651-18c0-431d-9055-09ca1ace5cfb req-a3b5bf0d-c2b4-41f0-8313-499c3e6b4e80 service nova] Enqueued Resource ID: d295366b-068f-4aa2-b950-1e6c682e7506 with Priority: HIGHEST for action port [ 896.367267] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_rules [ 896.367405] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 896.367501] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d295366b-068f-4aa2-b950-1e6c682e7506 with Priority: HIGHEST for action port [ 896.367811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.367945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.367945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.368578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.368667] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.370075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.370224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.370298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.370478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.370628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.370730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.370812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.370973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.371062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.371166] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.371868] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d295366b-068f-4aa2-b950-1e6c682e7506 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.372447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.372447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.372447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.372447] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d295366b-068f-4aa2-b950-1e6c682e7506',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.701146] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.874105] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.875166] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.875292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.875446] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d295366b-068f-4aa2-b950-1e6c682e7506 with status ACTIVE [ 896.875613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.875721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.875791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.875990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.876211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.876277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.876377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.876410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.877120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.877120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.877120] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.877120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.877120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.877120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.877461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.877461] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d295366b-068f-4aa2-b950-1e6c682e7506 is going to be updated. [ 896.899559] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.899873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.899942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.900137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.900285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.900446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d295366b-068f-4aa2-b950-1e6c682e7506" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.203634] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.203943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.203943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.204175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.204266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.204363] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 897.234260] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.234458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.234458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.234674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.234833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.244847] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 897.379695] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.883457] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.883457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.883457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.883457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.883457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.883457] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 897.934133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.934353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.934411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.934708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.934841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.950957] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 899.253646] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 899.254048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.254048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.254271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.254460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.254575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.254631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.254957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.254957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.255187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.255187] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.757915] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.758124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.758219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.758456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.758621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.759439] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.759439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.759859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.759859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.759945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.759981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.760140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.760263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.760342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.760441] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.966297] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 899.966577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.966777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.967062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.967291] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.967433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.967499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.967697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.967806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.967892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.967982] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.263207] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb6e69ce-aa18-43cb-be60-af4e37502a7a: rpc.has_security_group_logging(os_id): False [ 900.285133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.285493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.285779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.285873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.319214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.319467] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.319586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.319650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.319904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.319995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.320278] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.320415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.320495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.320702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.320799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.321089] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.321251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.321351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.321509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.321627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.321733] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 900.439023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.439023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.439217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.439395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.439600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.457541] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 900.470155] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.470330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.470395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.470624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.470730] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.470859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.470951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.471055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.471158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.471397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.471572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.471678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.471741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.471910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.472067] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.472173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.472278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.472394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.472474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472645] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.975171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1222eeb9-9dbe-496c-9f03-31010145cde2: rpc.has_security_group_logging(os_id): False [ 900.993343] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.993516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.993582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.993931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.014625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.014625] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.014625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.014625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.014625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.014890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.015050] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.015224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.015325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.015514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.015625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.015835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.015984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.016098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.016273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.016403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.016506] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 901.084024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.084024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.084024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.084024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.084370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.100201] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 901.372214] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.372214] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 902.478849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 902.478849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.918291] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ec0028e2-5f18-4d0a-86d4-7ab1008c4744 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 902.919867] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 902.919867] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.919867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.919867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.920411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.920541] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.037417] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8f15aa08-8b34-4b1d-b690-380a132d272a tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 903.037977] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 903.038273] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.038458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.120237] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 903.120237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.442531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.442735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.442735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.443109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.443228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.443335] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 already deleted. [ 903.443423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.443582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.443749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.443835] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.967393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.967690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.967690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.968010] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.968168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.968273] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 already deleted. [ 903.968357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.717395] env[65469]: INFO networking_nsxv3.common.synchronization [req-254547f4-5360-4885-8a11-7ffaffe16fd6 req-68f5fe72-84f3-4eff-881f-192539406815 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 904.720521] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 904.720521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.720521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.720521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.720976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.720976] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.142028] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.142028] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.142028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.142921] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.143286] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.143539] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.143764] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.143982] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.146093] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.146093] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.146093] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.165068] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.165593] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.165876] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.167958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.167958] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-00920ca8-211d-4c1e-b25e-d8ffefa272cc taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.167958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.167958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.167958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.167958] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00920ca8-211d-4c1e-b25e-d8ffefa272cc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.225740] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.225989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.225989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.226239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.249236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.249501] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.249971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.250120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.250175] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 905.280618] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.280618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.280618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.280618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.280618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.290903] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 905.671707] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.672018] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.672193] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.672534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.672740] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.672949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 00920ca8-211d-4c1e-b25e-d8ffefa272cc not found, creating... [ 905.673304] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.673525] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.673682] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.673954] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.674159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.674507] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.674713] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.674875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.675173] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.675345] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.675513] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 00920ca8-211d-4c1e-b25e-d8ffefa272cc is going to be created. [ 905.695758] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.696234] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.696482] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.696782] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.697045] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.697489] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.483921] env[65469]: INFO networking_nsxv3.common.synchronization [req-254547f4-5360-4885-8a11-7ffaffe16fd6 req-ae679c28-69a0-40a7-8d12-b680b576a85f service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 906.484270] env[65469]: INFO networking_nsxv3.common.synchronization [req-254547f4-5360-4885-8a11-7ffaffe16fd6 req-ae679c28-69a0-40a7-8d12-b680b576a85f service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 906.484720] env[65469]: INFO networking_nsxv3.common.synchronization [req-254547f4-5360-4885-8a11-7ffaffe16fd6 req-ae679c28-69a0-40a7-8d12-b680b576a85f service nova] Enqueued Resource ID: 00920ca8-211d-4c1e-b25e-d8ffefa272cc with Priority: HIGHEST for action port [ 906.485426] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 906.485726] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 906.485788] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00920ca8-211d-4c1e-b25e-d8ffefa272cc with Priority: HIGHEST for action port [ 906.486152] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.486250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.486368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.486592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.486755] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.487606] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.487726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.487952] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-00920ca8-211d-4c1e-b25e-d8ffefa272cc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.488041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.488131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.488244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.488321] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00920ca8-211d-4c1e-b25e-d8ffefa272cc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.990147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.990147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.990393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00920ca8-211d-4c1e-b25e-d8ffefa272cc with status ACTIVE [ 906.990586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.990678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.990743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.991122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.991315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.991528] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.991668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.992357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.992599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.992712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.992978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.993164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.993213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.993435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.993568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.993738] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00920ca8-211d-4c1e-b25e-d8ffefa272cc is going to be updated. [ 907.022045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.022186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.022383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.022650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.022870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.023669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00920ca8-211d-4c1e-b25e-d8ffefa272cc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.304114] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 907.304337] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 907.304471] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.305300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.305300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.305300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.305300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.305300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.305557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.305557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.305618] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.808075] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.311048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.814359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.814709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.814709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.814859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.814954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.815081] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 908.849123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.849291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.849363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.849571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.849811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.861653] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 910.875373] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 910.875760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.875872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.876172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.876428] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.876583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.876722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.876861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.876972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.877148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.877257] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.379785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.380147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.380333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.380569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.380809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.380994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.381233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.381442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.381578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.381722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.381919] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.382059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.382190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.382410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.382616] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.382763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.382833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.382976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.383077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.383162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.383252] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.487044] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 911.487172] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 911.885305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 911.904991] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.905430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.905430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.905430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.905579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.906262] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.906262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.906262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.906262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.906262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.906262] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.906580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.906580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.906580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.906580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.906779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.906868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.906932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.907352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.907352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.907424] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 911.976551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.976551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.976658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.976811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.976967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.012517] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 914.032979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 914.033370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.488875] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 916.488875] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 917.245616] env[65469]: INFO networking_nsxv3.common.synchronization [req-31ac6a52-1ab5-4ab3-bf54-9d155f4c9e36 req-b587bb39-adde-4aff-bb2a-fcb51a9af865 tempest-ServerPasswordTestJSON-361082223 tempest-ServerPasswordTestJSON-361082223-project-member] Enqueued Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 917.245616] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 917.245777] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.245902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.245954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.247587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.247587] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.247739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.247774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.247956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.248880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.248880] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.742450] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.742899] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-920" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.742899] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-920" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.743158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-920" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.743436] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.743596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.743715] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.743935] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.744092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.744299] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.744411] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.744517] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.744622] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.744727] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.744887] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.745040] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.751715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.751840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.751912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.752147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.752243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.752431] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.752519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.752587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.752734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.752861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.752953] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc already deleted. [ 917.753084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.768541] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.768782] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.768863] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.769051] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-920" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.769488] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-64944cfd-a6fa-4697-8753-a81ffcc88c7e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.769724] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.769860] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.770863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.770863] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64944cfd-a6fa-4697-8753-a81ffcc88c7e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.891837] env[65469]: INFO networking_nsxv3.common.synchronization [req-874cd1ad-b5d3-4b92-80dc-90987c35ce64 req-4849e28c-5dac-4fa7-9a1f-e0f9252198e7 tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 917.892362] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 917.892669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.892803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.892889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.893109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.893274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.893397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.893434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.893574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.893655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.893746] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.272909] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.273125] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.273254] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.273571] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.273743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.273920] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 64944cfd-a6fa-4697-8753-a81ffcc88c7e not found, creating... [ 918.274237] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.274421] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.274576] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.274828] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.274996] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.275359] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.275551] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.275683] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.275907] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.276095] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.276272] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 64944cfd-a6fa-4697-8753-a81ffcc88c7e is going to be created. [ 918.302692] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.302692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.302692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.302878] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.303434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.303434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.395987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.396195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.396244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.396518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.419329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.419851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.419851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.419851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.420352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.420442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.420534] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 918.474428] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.474642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.474745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.475070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.475221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.494983] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 919.000188] env[65469]: INFO networking_nsxv3.common.synchronization [req-31ac6a52-1ab5-4ab3-bf54-9d155f4c9e36 req-65a229ea-3ef5-4024-acda-984f121dfd92 service nova] Enqueued Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_rules [ 919.000447] env[65469]: INFO networking_nsxv3.common.synchronization [req-31ac6a52-1ab5-4ab3-bf54-9d155f4c9e36 req-65a229ea-3ef5-4024-acda-984f121dfd92 service nova] Enqueued Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 919.000648] env[65469]: INFO networking_nsxv3.common.synchronization [req-31ac6a52-1ab5-4ab3-bf54-9d155f4c9e36 req-65a229ea-3ef5-4024-acda-984f121dfd92 service nova] Enqueued Resource ID: 64944cfd-a6fa-4697-8753-a81ffcc88c7e with Priority: HIGHEST for action port [ 919.001406] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_rules [ 919.001600] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 919.001750] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64944cfd-a6fa-4697-8753-a81ffcc88c7e with Priority: HIGHEST for action port [ 919.002155] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.002325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.002423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.002759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.002880] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.005178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.006131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.006278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.008321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.008321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.008442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.008479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.008685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.009132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.009132] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.010374] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-64944cfd-a6fa-4697-8753-a81ffcc88c7e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.012224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.012224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.012224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.012224] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64944cfd-a6fa-4697-8753-a81ffcc88c7e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.506290] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.506290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.517894] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.519588] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64944cfd-a6fa-4697-8753-a81ffcc88c7e with status ACTIVE [ 919.520715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.520715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.520715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.521174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.521287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.521503] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.521632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.522215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.522215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.522215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.522388] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64944cfd-a6fa-4697-8753-a81ffcc88c7e is going to be updated. [ 919.545951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.546128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.546202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.546409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.546547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.546711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64944cfd-a6fa-4697-8753-a81ffcc88c7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.020929] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.515092] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 920.515332] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 920.516125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.523844] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.524026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.524114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.524317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.524405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.524920] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc is going to be created. [ 920.556264] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.556264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.556264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.556453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.556619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.566084] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: UNINITIALIZED for 2s [ 922.577459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: SUCCESS [ 922.577846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.577900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.578285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.578556] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.578668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.578737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.578919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.579106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.579106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.579222] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.081805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.081988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.082042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.082292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.082480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.082629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.082757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.083524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.083621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.083744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.083932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.084092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.084180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.084341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.084492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.084585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.084648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.084825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.085122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.085122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.085242] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.587398] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bde506b-06fa-4939-b031-63dc38218dcc: rpc.has_security_group_logging(os_id): False [ 923.608473] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.608622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.608701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.608922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.609034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.609232] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.609331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.609395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.609553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.609631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.609811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.609905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.609968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.610210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.610279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.610460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.610569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.610645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.610804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.610881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.610966] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc is going to be created. [ 923.677055] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.677269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.677269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.677493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.677678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.690957] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: IN_PROGRESS for 2s [ 924.003181] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.003419] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 924.862597] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6eccc7bf-03ec-4fb7-bba6-9257ba03ddcf None None] Enqueued Resource ID: 9bcba4e5-11b3-45fc-8573-d9d3f88d55fe with Priority: HIGHEST for action port [ 924.863232] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bcba4e5-11b3-45fc-8573-d9d3f88d55fe with Priority: HIGHEST for action port [ 924.864337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bcba4e5-11b3-45fc-8573-d9d3f88d55fe taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.864766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bcba4e5-11b3-45fc-8573-d9d3f88d55fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.864935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bcba4e5-11b3-45fc-8573-d9d3f88d55fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.865352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bcba4e5-11b3-45fc-8573-d9d3f88d55fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.865586] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bcba4e5-11b3-45fc-8573-d9d3f88d55fe',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.369408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bcba4e5-11b3-45fc-8573-d9d3f88d55fe [ 925.369629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.369777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.370233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.370477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.370658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.370786] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bcba4e5-11b3-45fc-8573-d9d3f88d55fe already deleted. [ 925.370870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bcba4e5-11b3-45fc-8573-d9d3f88d55fe" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.710038] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: SUCCESS [ 925.710038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.773225] env[65469]: INFO networking_nsxv3.common.synchronization [None req-0ea6b89b-020a-4b79-a4e7-33f3842497c7 None None] Enqueued Resource ID: 71ac8590-75c9-468a-8674-2b64ec76c51c with Priority: HIGHEST for action port [ 925.773225] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ac8590-75c9-468a-8674-2b64ec76c51c with Priority: HIGHEST for action port [ 925.773225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ac8590-75c9-468a-8674-2b64ec76c51c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.773225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ac8590-75c9-468a-8674-2b64ec76c51c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.773225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ac8590-75c9-468a-8674-2b64ec76c51c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.773225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ac8590-75c9-468a-8674-2b64ec76c51c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.773225] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ac8590-75c9-468a-8674-2b64ec76c51c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.279191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ac8590-75c9-468a-8674-2b64ec76c51c [ 926.279191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.279191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.279191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.279191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.279191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.279191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ac8590-75c9-468a-8674-2b64ec76c51c already deleted. [ 926.279191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ac8590-75c9-468a-8674-2b64ec76c51c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.490937] env[65469]: INFO networking_nsxv3.common.synchronization [req-9ba02322-f524-476b-830b-3133dc744b6b req-fb002789-4adf-430b-99d9-3b5448d404d8 tempest-DeleteServersAdminTestJSON-1207111285 tempest-DeleteServersAdminTestJSON-1207111285-project-member] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 926.491129] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 926.494304] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.494304] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.494304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.494794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.494794] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.998927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.998927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.999178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.999215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.027225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.027225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.027225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.027225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.027225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.027225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.027225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be updated. [ 927.053814] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.054017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.054111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.054344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.054490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.070169] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 927.139304] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.139439] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.139541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.140206] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.140725] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.140725] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.140879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.141096] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.141217] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.141450] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.141572] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.141682] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.141792] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.141903] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.142038] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.142150] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.157787] env[65469]: INFO networking_nsxv3.common.synchronization [None req-3382d787-59bc-4333-813b-77df34ebe638 None None] Enqueued Resource ID: 517cf401-1921-401f-aff7-1a17caf66e94 with Priority: HIGHEST for action port [ 927.158246] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 517cf401-1921-401f-aff7-1a17caf66e94 with Priority: HIGHEST for action port [ 927.158569] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-517cf401-1921-401f-aff7-1a17caf66e94 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.158668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-517cf401-1921-401f-aff7-1a17caf66e94" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.158668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-517cf401-1921-401f-aff7-1a17caf66e94" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.159126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-517cf401-1921-401f-aff7-1a17caf66e94" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.159126] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517cf401-1921-401f-aff7-1a17caf66e94',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.164247] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.164724] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.164944] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.165336] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.165698] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-858a438b-f3fe-4411-bca9-a00891ab0948 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.167138] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.167192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.170244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.170244] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('858a438b-f3fe-4411-bca9-a00891ab0948',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.669793] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 517cf401-1921-401f-aff7-1a17caf66e94 [ 927.670253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.670384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.670459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.670814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.670969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.671113] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:517cf401-1921-401f-aff7-1a17caf66e94 already deleted. [ 927.671278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-517cf401-1921-401f-aff7-1a17caf66e94" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.672415] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.672717] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.672974] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.675047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 858a438b-f3fe-4411-bca9-a00891ab0948 not found, creating... [ 927.675047] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.675047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.676264] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.676264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.676264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.676499] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.676533] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.676661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 858a438b-f3fe-4411-bca9-a00891ab0948 is going to be created. [ 927.701392] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.701541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.701612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.704577] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.704673] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.704853] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.367696] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9f92cd37-232f-464c-9eeb-3d9046285f43 None None] Enqueued Resource ID: a28ee593-c9eb-4cff-9239-5710d032b52f with Priority: HIGHEST for action port [ 928.368421] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28ee593-c9eb-4cff-9239-5710d032b52f with Priority: HIGHEST for action port [ 928.368845] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a28ee593-c9eb-4cff-9239-5710d032b52f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.368985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a28ee593-c9eb-4cff-9239-5710d032b52f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.369089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a28ee593-c9eb-4cff-9239-5710d032b52f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.369379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a28ee593-c9eb-4cff-9239-5710d032b52f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.369504] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28ee593-c9eb-4cff-9239-5710d032b52f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.490846] env[65469]: INFO networking_nsxv3.common.synchronization [req-9ba02322-f524-476b-830b-3133dc744b6b req-725e1501-e8a1-4400-a80c-9b16abd70ae0 service nova] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_rules [ 928.491035] env[65469]: INFO networking_nsxv3.common.synchronization [req-9ba02322-f524-476b-830b-3133dc744b6b req-725e1501-e8a1-4400-a80c-9b16abd70ae0 service nova] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 928.491206] env[65469]: INFO networking_nsxv3.common.synchronization [req-9ba02322-f524-476b-830b-3133dc744b6b req-725e1501-e8a1-4400-a80c-9b16abd70ae0 service nova] Enqueued Resource ID: 858a438b-f3fe-4411-bca9-a00891ab0948 with Priority: HIGHEST for action port [ 928.491750] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_rules [ 928.491901] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 928.494987] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858a438b-f3fe-4411-bca9-a00891ab0948 with Priority: HIGHEST for action port [ 928.495460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.495663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.496484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.496761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.496906] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.497939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.498132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.499244] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-858a438b-f3fe-4411-bca9-a00891ab0948 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.499244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.499244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.500834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.500973] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('858a438b-f3fe-4411-bca9-a00891ab0948',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.874298] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a28ee593-c9eb-4cff-9239-5710d032b52f [ 928.874298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.874298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.874298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.874298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.874298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.874298] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a28ee593-c9eb-4cff-9239-5710d032b52f already deleted. [ 928.874298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a28ee593-c9eb-4cff-9239-5710d032b52f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.996021] env[65469]: INFO networking_nsxv3.common.synchronization [None req-bc07695b-804c-4588-ac25-f28b9be7d014 tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 928.996021] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 928.996021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.996021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.996021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.997569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.998909] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.003432] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.003432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.003432] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 858a438b-f3fe-4411-bca9-a00891ab0948 with status ACTIVE [ 929.003558] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.003614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.003644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.003859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.004187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.004187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.004427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.004427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.004521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.004586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.004822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.004891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.004922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.005114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.005145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.005228] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 858a438b-f3fe-4411-bca9-a00891ab0948 is going to be updated. [ 929.033315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.033454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.033454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.033651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.033791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.033955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-858a438b-f3fe-4411-bca9-a00891ab0948" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.081578] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 929.081847] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 deletion is rescheduled due to dependency. [ 929.081847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.081966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.082198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.082381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.082500] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.082565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.082691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.082773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.082867] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.161279] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e07d934f-88b7-43c4-a2d2-f9e92baceabb tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 929.161765] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 929.161878] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.162076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.195537] env[65469]: INFO networking_nsxv3.common.synchronization [req-e528d551-e1ec-4e8f-8c8a-2afe6ca5dd2a req-55265f8a-9147-4fd5-8fef-5892d1b42f6f tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 929.195677] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 929.196067] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.199429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.199429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.199429] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.518586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.518725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.518798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.519473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.519473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.519473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 already deleted. [ 929.519473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.519473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.519713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.519713] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.585312] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.702236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.702236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.702236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.702236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.724309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.724591] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.724718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.724779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.724986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.725079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.725167] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 929.769642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.769788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.769856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.770069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.770248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.779849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 930.042205] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.042656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.042656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.042656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.042656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.042884] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 already deleted. [ 930.042884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.087365] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.412792] env[65469]: INFO networking_nsxv3.common.synchronization [req-be8643ac-6b5b-4086-a3ce-3fc077396a39 req-226490f2-062d-4a36-8421-b102e70615b4 tempest-MigrationsAdminTest-86543141 tempest-MigrationsAdminTest-86543141-project-member] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 930.412792] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGHEST for action security_group_members [ 930.414591] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.414701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.414741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.415150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.415150] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.415262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.415262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.415509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.415509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.415600] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.591839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.592046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.592160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.592542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.592757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.594135] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be updated. [ 930.639277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.639424] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.639492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.639701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.639850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.650515] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 930.725780] env[65469]: INFO networking_nsxv3.common.synchronization [req-5573b0ca-ca39-4e8c-ac2f-e93106034477 req-ef05c8ae-ce3b-45c3-a7b1-e825fa80d3f7 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 930.726378] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 930.726718] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.727448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.727448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.728147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.728332] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.728452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.728518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.728711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.728800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.728899] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.917933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.918155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.918210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.918794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.944414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.944921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.944921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.944921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.945254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.945254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.945254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be updated. [ 930.975904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.975904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.975904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.976122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.976178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.989072] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: IN_PROGRESS for 2s [ 931.137371] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.137702] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.138600] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.138956] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.139571] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.139571] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.139571] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.139907] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.139907] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.140375] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.140510] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.141102] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.141102] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.141102] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.141102] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.141102] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.161818] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.161818] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.161818] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.162783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.162783] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.162783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.162783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.163164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.163359] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.231549] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.231763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.231838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.232127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.232223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.232731] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.232883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.232992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.233305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.233462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.233666] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 already deleted. [ 931.233827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.667560] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.667805] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.667940] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.668329] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.668491] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.668874] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 not found, creating... [ 931.668943] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.669077] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.669211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.669463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.669602] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.669935] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.670728] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.670953] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.671197] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.671399] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.671609] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 is going to be created. [ 931.695297] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.695297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.695297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.695297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.695297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.695528] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.794762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 931.795405] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 931.795405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.448304] env[65469]: INFO networking_nsxv3.common.synchronization [req-5573b0ca-ca39-4e8c-ac2f-e93106034477 req-6886e4d4-79fb-4f76-9061-5baa0b862173 service nova] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 932.448731] env[65469]: INFO networking_nsxv3.common.synchronization [req-5573b0ca-ca39-4e8c-ac2f-e93106034477 req-6886e4d4-79fb-4f76-9061-5baa0b862173 service nova] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 932.448965] env[65469]: INFO networking_nsxv3.common.synchronization [req-5573b0ca-ca39-4e8c-ac2f-e93106034477 req-6886e4d4-79fb-4f76-9061-5baa0b862173 service nova] Enqueued Resource ID: 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 with Priority: HIGHEST for action port [ 932.449563] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_rules [ 932.449761] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 932.449908] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 with Priority: HIGHEST for action port [ 932.450321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.450459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.450574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.450870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.450870] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.451734] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.451847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.451913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.452097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.452238] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.452330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.452390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.452523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.452605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.452690] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.455235] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.455235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.455235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.455677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.455677] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.661710] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 932.661942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.662775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.662775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.662775] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.662775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.662775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.663041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.663041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.663041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.663138] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.957947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.958189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.958434] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.959368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 with status ACTIVE [ 932.959605] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.959758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.959854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.960405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.960405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.960405] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.960671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.960671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.960868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.960984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.961270] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.961641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.961641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.961641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.961923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.961923] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697 is going to be updated. [ 932.987025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.987025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.987025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.987237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.987237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.987359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffd54ca-0aa7-4a17-a3ff-7ffbc8ab2697" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.998918] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 in Status: SUCCESS [ 932.999658] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 deletion is rescheduled due to dependency. [ 932.999658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.166501] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.166501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.166501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.166829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.167065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.167169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.167287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.167397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.167506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.167626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.167801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.167900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.167963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.168126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.168312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.168420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.168482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.168644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.168757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.168860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.168963] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.463646] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.673655] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d29c1b7-7d3c-4651-9e62-14cee71b96b1: rpc.has_security_group_logging(os_id): False [ 933.696769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.696912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.697357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.697357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.697357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.697576] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.697576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.697878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.697878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.697878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.698068] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.698162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.698238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.698386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.698461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.698651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.698746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.698807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.699021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.699021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.699097] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be updated. [ 933.770565] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.770766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.770863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.772389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.772389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.789888] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 933.968649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.968727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.968777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.969013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.969101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.969214] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 is going to be created. [ 934.000016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.000239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.000336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.000598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.000758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.017309] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: UNINITIALIZED for 2s [ 934.494500] env[65469]: INFO networking_nsxv3.common.synchronization [None req-67273f77-c780-4c6c-a7cf-75f1ec71d91d None None] Enqueued Resource ID: e66e7ed4-dd4d-48ca-8160-e5358d1c85c4 with Priority: HIGHEST for action port [ 934.495053] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66e7ed4-dd4d-48ca-8160-e5358d1c85c4 with Priority: HIGHEST for action port [ 934.495363] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e66e7ed4-dd4d-48ca-8160-e5358d1c85c4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.495623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e66e7ed4-dd4d-48ca-8160-e5358d1c85c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.495623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e66e7ed4-dd4d-48ca-8160-e5358d1c85c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.495876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e66e7ed4-dd4d-48ca-8160-e5358d1c85c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.495955] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66e7ed4-dd4d-48ca-8160-e5358d1c85c4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.946172] env[65469]: INFO networking_nsxv3.common.synchronization [req-e494286c-bb65-42a6-ad9d-572a8ce213ca req-5f717b81-950c-4bbc-93eb-99e7c48d9be9 tempest-ServerRescueTestJSON-1121830031 tempest-ServerRescueTestJSON-1121830031-project-member] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 934.946172] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 934.946618] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.947295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.947580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.947907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.948266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.952043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.952043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.952043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.952043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.952043] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.002477] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e66e7ed4-dd4d-48ca-8160-e5358d1c85c4 [ 935.002798] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.002941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.003032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.003922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.003922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.004220] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e66e7ed4-dd4d-48ca-8160-e5358d1c85c4 already deleted. [ 935.004220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e66e7ed4-dd4d-48ca-8160-e5358d1c85c4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.453838] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.505927] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.506292] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.506292] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.506762] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.507413] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.507653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.507811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.508233] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.508430] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.508904] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.509070] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.509254] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.509424] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.509678] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.510076] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.510858] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.517561] env[65469]: INFO networking_nsxv3.common.synchronization [None req-649e8c6f-fd60-424c-90c2-72c085343238 None None] Enqueued Resource ID: 6df61a4a-28db-4d79-a1b2-72663543d3ff with Priority: HIGHEST for action port [ 935.519997] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df61a4a-28db-4d79-a1b2-72663543d3ff with Priority: HIGHEST for action port [ 935.521074] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df61a4a-28db-4d79-a1b2-72663543d3ff taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.521256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df61a4a-28db-4d79-a1b2-72663543d3ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.521256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df61a4a-28db-4d79-a1b2-72663543d3ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.521645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df61a4a-28db-4d79-a1b2-72663543d3ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.521801] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df61a4a-28db-4d79-a1b2-72663543d3ff',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.543095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.543281] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.543388] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.543566] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-465" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.544514] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-5920c25e-e754-4d6c-814e-7106c0ad8bb8 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.544514] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.544514] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.544768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.544844] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5920c25e-e754-4d6c-814e-7106c0ad8bb8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.807910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 935.808041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.958416] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.025518] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df61a4a-28db-4d79-a1b2-72663543d3ff [ 936.025728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.025834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.025834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.026190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.026190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.026418] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df61a4a-28db-4d79-a1b2-72663543d3ff already deleted. [ 936.026466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df61a4a-28db-4d79-a1b2-72663543d3ff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.031612] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: SUCCESS [ 936.031735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.032617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.032617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.032617] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.032617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.032617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.032941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.032941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.032941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.032941] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.053177] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.053177] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 5920c25e-e754-4d6c-814e-7106c0ad8bb8 not found, creating... [ 936.053177] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.053177] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.053649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.053649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.053793] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.054633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.054633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.054633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.054633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.054633] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 5920c25e-e754-4d6c-814e-7106c0ad8bb8 is going to be created. [ 936.217585] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.217933] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.218030] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.218515] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.218649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.218806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.462236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.462408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.462515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.462742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.462839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.462939] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be updated. [ 936.497970] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.497970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.498098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.498261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.498403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.509554] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 936.537191] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.846908] env[65469]: INFO networking_nsxv3.common.synchronization [req-e494286c-bb65-42a6-ad9d-572a8ce213ca req-b20f2614-cb2a-4794-8eeb-ae34983a4d22 service nova] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_rules [ 936.847221] env[65469]: INFO networking_nsxv3.common.synchronization [req-e494286c-bb65-42a6-ad9d-572a8ce213ca req-b20f2614-cb2a-4794-8eeb-ae34983a4d22 service nova] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 936.847459] env[65469]: INFO networking_nsxv3.common.synchronization [req-e494286c-bb65-42a6-ad9d-572a8ce213ca req-b20f2614-cb2a-4794-8eeb-ae34983a4d22 service nova] Enqueued Resource ID: 5920c25e-e754-4d6c-814e-7106c0ad8bb8 with Priority: HIGHEST for action port [ 936.848554] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_rules [ 936.848554] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 936.848705] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5920c25e-e754-4d6c-814e-7106c0ad8bb8 with Priority: HIGHEST for action port [ 936.848951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.849121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.849191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.849608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.849608] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.850650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.850753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.851101] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-5920c25e-e754-4d6c-814e-7106c0ad8bb8 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.851374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.851490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.851738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.851831] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5920c25e-e754-4d6c-814e-7106c0ad8bb8',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.935953] env[65469]: INFO networking_nsxv3.common.synchronization [req-d3e7e37e-8821-458f-92fe-10d0b52e0504 req-afd93736-d811-47d7-8046-1c5168a599dc tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 936.936283] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 936.936991] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.937216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.937326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.937599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.937895] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.938127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.938385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.938586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.938815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.938928] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.039536] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4f7ec7-5508-45fa-9dca-52ca3bb66953: rpc.has_security_group_logging(os_id): False [ 937.065161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.065333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.065435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.065625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.065731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.066033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.066155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.066220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.066389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.066465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.066608] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 is going to be created. [ 937.192498] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.192815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.192910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.193273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.193690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: IN_PROGRESS for 2s [ 937.356274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.356274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.356274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5920c25e-e754-4d6c-814e-7106c0ad8bb8 with status ACTIVE [ 937.356274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.356274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.356274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.356274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.356274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.356902] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.356902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.356902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.356902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.356902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.357086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.357896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.357896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.357896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.357896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.357896] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5920c25e-e754-4d6c-814e-7106c0ad8bb8 is going to be updated. [ 937.395092] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.395325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.395431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.395689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.395857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.396138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5920c25e-e754-4d6c-814e-7106c0ad8bb8" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.443890] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.467706] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.467849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468900] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468983] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.469119] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.469339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.469490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.471068] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.471068] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.471068] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.471068] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.471068] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.471068] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.471068] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.510036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.510036] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.510036] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.510036] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.510036] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.510604] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.510604] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.510832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.510949] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.617326] env[65469]: INFO networking_nsxv3.common.synchronization [None req-aa122fc0-2448-42a1-b8a6-e5c6c8c58a91 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 937.617736] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 937.618473] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.619677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.619677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.619677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.619677] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.805903] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c71f2ec3-4697-4c7a-b987-f621a2e14154 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 937.806580] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 937.807036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.807187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.945653] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.013848] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.014191] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.014191] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.014904] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.014904] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.014904] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 not found, creating... [ 938.015176] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.015176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.015336] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.015647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.015647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.016148] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.016148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.016148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.016610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.016610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.016913] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 is going to be created. [ 938.039064] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.039538] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.039538] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.039798] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.040483] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.040483] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.077580] env[65469]: INFO networking_nsxv3.common.synchronization [None req-bfe4a247-a100-4953-bc33-f7cd6dcba9c6 None None] Enqueued Resource ID: 8bc9015f-cdd3-4ada-96cf-f86d112c63f7 with Priority: HIGHEST for action port [ 938.078290] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bc9015f-cdd3-4ada-96cf-f86d112c63f7 with Priority: HIGHEST for action port [ 938.078534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bc9015f-cdd3-4ada-96cf-f86d112c63f7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.079073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bc9015f-cdd3-4ada-96cf-f86d112c63f7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.079073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bc9015f-cdd3-4ada-96cf-f86d112c63f7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.079073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bc9015f-cdd3-4ada-96cf-f86d112c63f7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.079073] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc9015f-cdd3-4ada-96cf-f86d112c63f7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.154328] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.154536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.154536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.155933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.156084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.156251] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a already deleted. [ 938.156251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.156403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.156573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.156710] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.448845] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.448946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.449012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.450052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.450052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.450189] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 938.500027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.500027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.500257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.503202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.503202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.513858] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 938.526462] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 938.526801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.526904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.527069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.527306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.527376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.527438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.527639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.527682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527770] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.582231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bc9015f-cdd3-4ada-96cf-f86d112c63f7 [ 938.582537] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.582693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.582784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.583033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.583160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.583297] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bc9015f-cdd3-4ada-96cf-f86d112c63f7 already deleted. [ 938.583422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bc9015f-cdd3-4ada-96cf-f86d112c63f7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.680975] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.681175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.681214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.681678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.681678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.681678] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a already deleted. [ 938.681826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.778591] env[65469]: INFO networking_nsxv3.common.synchronization [req-d3e7e37e-8821-458f-92fe-10d0b52e0504 req-e06d4fc4-358e-481b-849e-2cf0daaa7adb service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 938.778768] env[65469]: INFO networking_nsxv3.common.synchronization [req-d3e7e37e-8821-458f-92fe-10d0b52e0504 req-e06d4fc4-358e-481b-849e-2cf0daaa7adb service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 938.778932] env[65469]: INFO networking_nsxv3.common.synchronization [req-d3e7e37e-8821-458f-92fe-10d0b52e0504 req-e06d4fc4-358e-481b-849e-2cf0daaa7adb service nova] Enqueued Resource ID: 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 with Priority: HIGHEST for action port [ 938.779448] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 938.779586] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 938.779685] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 with Priority: HIGHEST for action port [ 938.780118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.782929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.782929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.782929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.782929] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.783570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.783752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.785612] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.785612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.785612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.785612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.785612] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.904539] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d401e5ee-850e-4435-be73-857509f5b5a9 None None] Enqueued Resource ID: 3c4b2c59-5381-4794-b390-de711f24db30 with Priority: HIGHEST for action port [ 938.905097] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4b2c59-5381-4794-b390-de711f24db30 with Priority: HIGHEST for action port [ 938.905409] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c4b2c59-5381-4794-b390-de711f24db30 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.905534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c4b2c59-5381-4794-b390-de711f24db30" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.905598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c4b2c59-5381-4794-b390-de711f24db30" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.905860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c4b2c59-5381-4794-b390-de711f24db30" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.905952] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4b2c59-5381-4794-b390-de711f24db30',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.030352] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.239634] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: SUCCESS [ 939.239634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.286561] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 with status ACTIVE [ 939.290028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.290028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.290028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.290853] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5 is going to be updated. [ 939.317384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.317384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.317384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.317384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.317384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.317384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d0b0b27-ef03-4c02-a946-ff5ecba2f9c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.410536] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c4b2c59-5381-4794-b390-de711f24db30 [ 939.410536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.410536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.410536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.410536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.410536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.410536] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c4b2c59-5381-4794-b390-de711f24db30 already deleted. [ 939.410536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c4b2c59-5381-4794-b390-de711f24db30" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.536695] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.039611] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.039825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.039900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.040151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.040310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.043449] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be updated. [ 940.079318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.079534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.079797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.079958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.081226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.091032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 940.529644] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 940.529887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.530104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.530628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.530834] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.530961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.531030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.531232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.531329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.531429] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.037424] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.380680] env[65469]: INFO networking_nsxv3.common.synchronization [req-86958463-c1f7-43fa-9303-c23281fb3b4c req-b2d7e361-da19-427e-876f-23018061a131 tempest-ServerPasswordTestJSON-361082223 tempest-ServerPasswordTestJSON-361082223-project-member] Enqueued Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 941.381223] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGHEST for action security_group_members [ 941.381740] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.381740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.381740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.381928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.382065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.382162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.382215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.382376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.382481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.382598] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.539347] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.885412] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.885412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.885676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.885710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.885941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.886032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.886119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.886176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.886334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.886456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.886578] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc is going to be updated. [ 941.924367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.924513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.924647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.925153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.928065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.944397] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: IN_PROGRESS for 2s [ 942.043348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.043348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.043348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.043348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.043348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.043348] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 942.075115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.075336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.075404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.075642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.075829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.085350] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 942.099937] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 942.100112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.100666] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.100889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.101182] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.101322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.101322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.101491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.101537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.101576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.101672] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.607121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.607121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.607121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.607121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.607121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.608439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.608439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.608439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.608439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.608439] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.112290] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc2d080-06d1-43db-887c-b69e9dc7db6e: rpc.has_security_group_logging(os_id): False [ 943.133975] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.133975] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.133975] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.135216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.135216] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be updated. [ 943.199491] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.199654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.199687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.199899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.200093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.214318] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 943.415835] env[65469]: INFO networking_nsxv3.common.synchronization [req-370c22ad-12af-43d2-86d9-57a8c3b75046 req-04b28433-fd7b-4dbf-885a-c9077942d542 tempest-DeleteServersAdminTestJSON-1207111285 tempest-DeleteServersAdminTestJSON-1207111285-project-member] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 943.416838] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGHEST for action security_group_members [ 943.416838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.416838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.416838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.417148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.417148] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.417217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.417477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.417561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.417618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.419050] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.922266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.922588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.922648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.922874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.922971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.923180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.923273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.923338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.923496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.923584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.923626] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be updated. [ 943.952900] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.953107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.953163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.953331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.953532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.960294] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bde506b-06fa-4939-b031-63dc38218dcc in Status: SUCCESS [ 943.960520] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc deletion is rescheduled due to dependency. [ 943.960655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.961514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: IN_PROGRESS for 2s [ 944.097570] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 944.097803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.097975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.098260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.098894] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.099044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.099114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.099304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.099390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.099479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.099573] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.365298] env[65469]: INFO networking_nsxv3.common.synchronization [req-27ed60b5-c9ca-4ee2-acbc-a095e2ff4dd5 req-3b7eaba6-c84e-4b81-a84d-87a0a3d3956b tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 944.366016] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 944.366377] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.366501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.366572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.366873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.367117] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.367225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.367309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.367529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.367717] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.367803] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.603944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.603944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.603944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.603944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.603944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.604591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.604591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.604591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.604591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.604591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.604591] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.836624] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.836624] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.836624] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.836624] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.836624] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.837078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.837520] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.837935] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.838207] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.838556] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.838797] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.838999] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.839261] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.839468] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.839661] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.839882] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.863141] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.863141] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.863141] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.863141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.863141] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-fde912c6-e862-44b7-a7d0-a882000fd7c3 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.863141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.863141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.863141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.863141] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fde912c6-e862-44b7-a7d0-a882000fd7c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.871415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.871635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.871751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.871987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872357] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.873697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.873697] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 944.902235] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.902419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.902465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.902813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.903067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.915147] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 945.109034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 945.128698] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.128698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.128935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.129044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.152634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.152634] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.152634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.152634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.152933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.152933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.153146] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.153248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.153312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.153505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.153582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.153720] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.153813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.153876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.154023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.154101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.154218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 945.225015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.225237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.225237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.225474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.225610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.229300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 945.229518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.237237] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 945.367136] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.367653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.367653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.368083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.368333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.368559] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port fde912c6-e862-44b7-a7d0-a882000fd7c3 not found, creating... [ 945.368944] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.369198] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.369366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.369670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.369822] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.370146] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.370347] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.370488] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.370735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.370879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.371333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: fde912c6-e862-44b7-a7d0-a882000fd7c3 is going to be created. [ 945.397958] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.398258] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.398425] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.398733] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.398995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.399318] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.531669] env[65469]: INFO networking_nsxv3.common.synchronization [req-7a96ca4f-6273-4e60-b953-b61e35c8dca1 req-8b1ae81e-771f-4256-a5f0-06122e71192b tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 945.532485] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 945.532896] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.533072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.533144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.533435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.533722] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.533839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.533896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.534162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.534358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.534443] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.971839] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 in Status: SUCCESS [ 945.972032] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 deletion is rescheduled due to dependency. [ 945.972150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.036940] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.108201] env[65469]: INFO networking_nsxv3.common.synchronization [req-27ed60b5-c9ca-4ee2-acbc-a095e2ff4dd5 req-ba83f4c5-5c0a-4327-a51a-147f527f593a service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 946.108546] env[65469]: INFO networking_nsxv3.common.synchronization [req-27ed60b5-c9ca-4ee2-acbc-a095e2ff4dd5 req-ba83f4c5-5c0a-4327-a51a-147f527f593a service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 946.108862] env[65469]: INFO networking_nsxv3.common.synchronization [req-27ed60b5-c9ca-4ee2-acbc-a095e2ff4dd5 req-ba83f4c5-5c0a-4327-a51a-147f527f593a service nova] Enqueued Resource ID: fde912c6-e862-44b7-a7d0-a882000fd7c3 with Priority: HIGHEST for action port [ 946.110165] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 946.110441] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 946.110604] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fde912c6-e862-44b7-a7d0-a882000fd7c3 with Priority: HIGHEST for action port [ 946.111133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.111482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.111482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.111802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.111966] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.113318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.113478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.113939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-fde912c6-e862-44b7-a7d0-a882000fd7c3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.115102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.115936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.116204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.116358] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fde912c6-e862-44b7-a7d0-a882000fd7c3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.540605] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.619038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.619038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.619333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fde912c6-e862-44b7-a7d0-a882000fd7c3 with status ACTIVE [ 946.619639] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.619870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.619974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.620410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.620410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.620594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.620696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.620758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.620880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.620943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.621158] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.621257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.621312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.621433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.621508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.621589] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fde912c6-e862-44b7-a7d0-a882000fd7c3 is going to be updated. [ 946.645412] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.645412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.645412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.645674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.645674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.645787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fde912c6-e862-44b7-a7d0-a882000fd7c3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.929651] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 946.929651] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.929651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.929651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.929651] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.044107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.044107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.044107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.044107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.044383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.044473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 947.079616] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.079767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.079836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.080051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.080197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.089215] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 947.254791] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 947.255953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.434986] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.936897] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.439637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.440419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.440419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.440419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.440419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.440419] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 948.473671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.474054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.474857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.474857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.474857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.485175] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 949.102739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 949.102999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.297700] env[65469]: INFO networking_nsxv3.common.synchronization [req-ece91895-f404-4c32-8255-46480d2701c5 req-20236bc2-dccd-4d51-96f6-7b2e6ce59150 tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 949.298597] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 949.298865] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.299015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.299248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.299488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.299642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.299764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.299822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.299975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.300073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.300184] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.670152] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.670596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.670754] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.671047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.671328] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.671562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.671680] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.671913] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.672078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.672291] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.672402] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.672509] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.672746] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.672949] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.673805] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.674025] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.699701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.700020] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.700271] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.700613] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-838" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.701127] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-c5419606-a0bb-4701-8bcf-34a80d824d9e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.701423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.701632] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.702118] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.702360] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5419606-a0bb-4701-8bcf-34a80d824d9e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.802516] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.802685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.802767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.803014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.803123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.803321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.803423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.803482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.803626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.803701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.803800] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 949.833026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.833026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.833026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.833308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.833398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.845877] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 950.205824] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.206123] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.206123] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.206372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.206526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.206683] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port c5419606-a0bb-4701-8bcf-34a80d824d9e not found, creating... [ 950.206941] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.207110] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.207209] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.207429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.207568] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.207851] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.207997] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.208404] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.208500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.208666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.208769] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: c5419606-a0bb-4701-8bcf-34a80d824d9e is going to be created. [ 950.235339] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.235746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.235746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.235946] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.236196] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.236498] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.499415] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 950.499603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.499735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.500016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.500256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.500680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.500776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.500975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.501093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.501192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.501323] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.608992] env[65469]: INFO networking_nsxv3.common.synchronization [req-d270673a-2db7-426e-9f84-d015e72b19e4 req-4a136fa0-75a8-446f-a955-f4d01786339a tempest-ServersNegativeTestJSON-2024414313 tempest-ServersNegativeTestJSON-2024414313-project-member] Enqueued Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 950.613979] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 with Priority: HIGHEST for action security_group_members [ 950.613979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1222eeb9-9dbe-496c-9f03-31010145cde2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.613979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.613979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.614350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.614493] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.614555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.614618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.614770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.614871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.614950] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1222eeb9-9dbe-496c-9f03-31010145cde2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.003488] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.003749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.003892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.006751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.006751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.006751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.006751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.006751] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [req-ece91895-f404-4c32-8255-46480d2701c5 req-04fe9bf5-3d57-4ff0-8849-1314bbef5d1f service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [req-ece91895-f404-4c32-8255-46480d2701c5 req-04fe9bf5-3d57-4ff0-8849-1314bbef5d1f service nova] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [req-ece91895-f404-4c32-8255-46480d2701c5 req-04fe9bf5-3d57-4ff0-8849-1314bbef5d1f service nova] Enqueued Resource ID: c5419606-a0bb-4701-8bcf-34a80d824d9e with Priority: HIGHEST for action port [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_rules [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 951.038218] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5419606-a0bb-4701-8bcf-34a80d824d9e with Priority: HIGHEST for action port [ 951.038218] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.038218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.038218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.038218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.038218] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.038815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.038957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.039100] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5419606-a0bb-4701-8bcf-34a80d824d9e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.039212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.039255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.039423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.039511] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5419606-a0bb-4701-8bcf-34a80d824d9e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.117469] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.117635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.117711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.117937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.118047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.118247] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.118370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.118438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.118750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.118823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.118914] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 is going to be updated. [ 951.157106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.157312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.157312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.157499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.157643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.167667] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: IN_PROGRESS for 2s [ 951.509631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 951.527379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.527532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.527602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.527830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.527923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.528492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.528492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.528492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.528492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.528854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.528854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.528854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.529076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.529076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.529143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.529337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.529422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.529422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.529587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.529587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.529747] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 951.542764] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.542932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.544279] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5419606-a0bb-4701-8bcf-34a80d824d9e with status ACTIVE [ 951.544520] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.544612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.544659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.544857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.544950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.545142] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.545241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.545304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.545466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.545546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.545839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.545924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.545961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.546105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.546187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.546271] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5419606-a0bb-4701-8bcf-34a80d824d9e is going to be updated. [ 951.567348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.567517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.567517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.567635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.567773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.568138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5419606-a0bb-4701-8bcf-34a80d824d9e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.605313] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.605556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.605687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.606056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.606290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.621333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 951.751161] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-07b5f47f-203f-4bf6-9169-089f2557065c tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 951.751161] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 951.751161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.751161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.751161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.751960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.752281] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.752550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.752751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.753064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.753287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.753512] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.859188] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 951.859347] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 951.859461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.859633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.859898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.860113] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.860240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.860284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.860488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.860553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.860655] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.124201] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.124407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.124521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.125714] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.125714] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.125926] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.125986] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.126312] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.126473] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.126685] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.126792] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.126902] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.127054] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.127121] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.127226] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.127359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.151935] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.152270] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.152270] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.152527] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.152931] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-dca131c3-2626-438a-b390-fae921cef117 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.153207] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.153451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.153715] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.153862] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca131c3-2626-438a-b390-fae921cef117',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.255973] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.256290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.256290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.256534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.256649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.256835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.256959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.257096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.257296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.257385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.257474] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 already deleted. [ 952.257557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.362692] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.658712] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.659062] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.659116] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.660152] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.660407] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.660618] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port dca131c3-2626-438a-b390-fae921cef117 not found, creating... [ 952.660940] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.661202] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.661369] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.661661] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.661844] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.662196] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.662445] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.662606] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.662865] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.663107] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.663246] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: dca131c3-2626-438a-b390-fae921cef117 is going to be created. [ 952.688521] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.688750] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.688842] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.689071] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.689312] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.689541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.865490] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.178417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 in Status: SUCCESS [ 953.178717] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1222eeb9-9dbe-496c-9f03-31010145cde2 deletion is rescheduled due to dependency. [ 953.178843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1222eeb9-9dbe-496c-9f03-31010145cde2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.368022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.368195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.368331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.368595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.368724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.368884] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 953.400653] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.400653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.400653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.400957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.401149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.410871] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 953.458566] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-a26ddffb-e995-4dc1-8967-80388c488c25 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 953.458749] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-a26ddffb-e995-4dc1-8967-80388c488c25 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 953.458884] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-a26ddffb-e995-4dc1-8967-80388c488c25 service nova] Enqueued Resource ID: dca131c3-2626-438a-b390-fae921cef117 with Priority: HIGHEST for action port [ 953.459454] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 953.459595] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 953.459698] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca131c3-2626-438a-b390-fae921cef117 with Priority: HIGHEST for action port [ 953.459985] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.460115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.460179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.460482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.460567] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.461848] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.461968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.462048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.462225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.462378] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.462484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.462531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.462679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.462896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.462896] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.463643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca131c3-2626-438a-b390-fae921cef117 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.463759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.463802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.464327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.464327] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca131c3-2626-438a-b390-fae921cef117',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.639886] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 953.640264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.965922] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.966702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.966702] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.967274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca131c3-2626-438a-b390-fae921cef117 with status ACTIVE [ 953.967463] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.967582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.967649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.967854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.967962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.968217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.968273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.968309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.968489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.968523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.968695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.968816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.968871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.968978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.969062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.969146] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca131c3-2626-438a-b390-fae921cef117 is going to be updated. [ 953.998526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.998734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.998824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.999132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.999324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.000070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca131c3-2626-438a-b390-fae921cef117" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.471509] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.974049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.974401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.974401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.974514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.975162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.975162] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be created. [ 955.004453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.004790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.004790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.005493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.005493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.018862] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: UNINITIALIZED for 2s [ 955.422118] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 955.422379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.422524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.422822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.422999] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.423213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.423286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.423462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.423540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.423626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.423763] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.925905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.926087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.926087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.926272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.926445] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.926561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.926621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.926745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.926833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.926917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.927075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.927194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.927241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.927346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.927669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.927669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.927669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.927899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.927899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.927899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.928078] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.429924] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49239a3f-71c3-4a6e-a70e-4e35fc82c66d: rpc.has_security_group_logging(os_id): False [ 956.453748] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.454060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.454060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.455054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.455054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.455054] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.455054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.455054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.455355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.455355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.455556] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.455682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.455742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.455901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.455988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.456277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.456415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.456477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.456655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.456764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.456878] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 956.551408] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.551658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.551768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.552071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.552261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.574592] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 956.631457] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-d17d44bb-fac5-432c-8972-638afd17a12a tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 956.632234] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 956.632702] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.632812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.033638] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.033638] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.033638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.033638] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.034901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.036658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.036658] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.036658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.036658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.036658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.036658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.036658] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.044705] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.044705] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.044705] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.045337] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.046292] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.046292] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.046292] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.046837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.047158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.049363] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.049363] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.049363] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.049363] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.049363] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.049363] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.049363] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.069978] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.069978] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.069978] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.069978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.069978] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-bca31752-d243-4a71-88ed-c52beb19825c taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.069978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.069978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.069978] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.069978] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca31752-d243-4a71-88ed-c52beb19825c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.540597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.540597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.543015] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.577028] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.577028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port bca31752-d243-4a71-88ed-c52beb19825c not found, creating... [ 957.577028] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.577028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.577570] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.577570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.577570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.577570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.577570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.577570] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: bca31752-d243-4a71-88ed-c52beb19825c is going to be created. [ 957.604140] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.604356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.604477] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.604758] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.604991] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.605287] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.044625] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.389210] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-16b8d2b0-caa9-44a9-a37b-c35e426bd4d7 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 958.389450] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-16b8d2b0-caa9-44a9-a37b-c35e426bd4d7 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 958.389627] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf46cf9c-a1ea-4eca-9f13-51ad2ed7b8b5 req-16b8d2b0-caa9-44a9-a37b-c35e426bd4d7 service nova] Enqueued Resource ID: bca31752-d243-4a71-88ed-c52beb19825c with Priority: HIGHEST for action port [ 958.390229] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 958.390638] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 958.390925] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca31752-d243-4a71-88ed-c52beb19825c with Priority: HIGHEST for action port [ 958.391350] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.391549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.392346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.393036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393036] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca31752-d243-4a71-88ed-c52beb19825c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.393036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.393521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.393699] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca31752-d243-4a71-88ed-c52beb19825c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.547745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.548146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.548146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.548232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.548403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.548403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 958.575584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.575792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.575792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.575907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.576065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.584763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 958.589020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 958.589237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.897109] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca31752-d243-4a71-88ed-c52beb19825c with status ACTIVE [ 958.898239] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.898239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.898239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.898239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.898239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.898239] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.898737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.898737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.898737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.898737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.898737] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.898888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.898888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.898967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.899078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.899283] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca31752-d243-4a71-88ed-c52beb19825c is going to be updated. [ 958.921905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.922055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.922055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.922355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.923050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.923050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca31752-d243-4a71-88ed-c52beb19825c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.603178] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 960.603178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.603701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.603801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.604019] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.604157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.604215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.604487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.604599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.604653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.604934] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.605087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.605087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.606163] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.606163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.606163] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.606850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.607662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.608740] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.608740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.608740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.608740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.608740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.608740] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.909540] env[65469]: INFO networking_nsxv3.common.synchronization [req-59db70a3-4235-4a4d-8425-93c1a6e0535d req-c47898ab-ed71-4ce3-9599-76aab4fdfcd5 tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 960.909540] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 960.910346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.910346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.910346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.911281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.911539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.911725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.911903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.912183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.912324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.912506] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.110504] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f107522e-6192-4b58-8a9d-bdf6cd660823: rpc.has_security_group_logging(os_id): False [ 961.113267] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.137494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.137494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.137494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.137494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.137805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.137805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.138664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.139128] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.139246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.139383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.139493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.139615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.139867] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be created. [ 961.218729] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.218898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.219039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.219225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.219431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.236339] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 961.415162] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.415371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.415419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.415631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.415736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.416630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.416630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.416630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.416630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.416630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.416630] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 961.452166] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.452343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.452410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.452678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.455840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.469592] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 961.617739] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.121708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.121708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.121708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.121708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.121708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.121708] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 962.158517] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.159058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.159058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.159058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.159163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.173188] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 962.436061] env[65469]: INFO networking_nsxv3.common.synchronization [req-efde697b-ed03-435d-beef-184495046709 req-934411c2-9e24-46c2-a416-92d1d5fd2280 tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 962.436478] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 962.437356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.437563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.437640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.437937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.438170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.438299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.438382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.438559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.438636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.438790] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.654332] env[65469]: INFO networking_nsxv3.common.synchronization [None req-1655f613-6dd8-4dfb-ac07-e9573e35b9ee None None] Enqueued Resource ID: 6bdf1dd9-a40a-44f0-8a98-2469244395eb with Priority: HIGHEST for action port [ 962.654332] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bdf1dd9-a40a-44f0-8a98-2469244395eb with Priority: HIGHEST for action port [ 962.655462] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bdf1dd9-a40a-44f0-8a98-2469244395eb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.655763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bdf1dd9-a40a-44f0-8a98-2469244395eb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.656084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bdf1dd9-a40a-44f0-8a98-2469244395eb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.656489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bdf1dd9-a40a-44f0-8a98-2469244395eb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.656698] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bdf1dd9-a40a-44f0-8a98-2469244395eb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.861189] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.861321] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.861429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.862183] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.862183] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.862183] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.862396] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.862512] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.862656] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.862912] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.863047] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.863239] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.863310] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.863380] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.863484] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.863678] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.884967] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.885200] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.885289] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.885475] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.885883] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-81885c6b-6889-4043-ad8d-59fb88097130 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.886085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.886210] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.886644] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.886829] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81885c6b-6889-4043-ad8d-59fb88097130',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.941935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.942147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.942211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.942410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.942540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.942833] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.942991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.943103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.943288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.943411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.943535] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 already deleted. [ 962.943628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.162714] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bdf1dd9-a40a-44f0-8a98-2469244395eb [ 963.163164] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.163164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.163329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.163420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.163504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.163659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bdf1dd9-a40a-44f0-8a98-2469244395eb already deleted. [ 963.163695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bdf1dd9-a40a-44f0-8a98-2469244395eb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.250675] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 963.250675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.250675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.250675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.250675] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.389366] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.389633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.389773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.390542] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.390712] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.390866] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 81885c6b-6889-4043-ad8d-59fb88097130 not found, creating... [ 963.391150] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.391463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.391463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.391662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.391799] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392106] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.392264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.392381] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.392589] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.392748] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392857] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 81885c6b-6889-4043-ad8d-59fb88097130 is going to be created. [ 963.415039] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.415039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.415039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.415039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.415039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.415039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.475533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 963.475727] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 963.475847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.753759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.754078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.188918] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 964.189193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.189333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.189551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.189741] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.189856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.189918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.190086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.190165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.190249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.190341] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.206652] env[65469]: INFO networking_nsxv3.common.synchronization [req-efde697b-ed03-435d-beef-184495046709 req-a64a67a8-02a4-4847-b62c-054ac70e4baf service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 964.206652] env[65469]: INFO networking_nsxv3.common.synchronization [req-efde697b-ed03-435d-beef-184495046709 req-a64a67a8-02a4-4847-b62c-054ac70e4baf service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 964.206652] env[65469]: INFO networking_nsxv3.common.synchronization [req-efde697b-ed03-435d-beef-184495046709 req-a64a67a8-02a4-4847-b62c-054ac70e4baf service nova] Enqueued Resource ID: 81885c6b-6889-4043-ad8d-59fb88097130 with Priority: HIGHEST for action port [ 964.207921] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 964.208152] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 964.208566] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81885c6b-6889-4043-ad8d-59fb88097130 with Priority: HIGHEST for action port [ 964.208929] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.209178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.209290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.209556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.209646] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.211251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.211427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.211576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.211940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.212146] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.212284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.212374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.212557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.212675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.212865] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.217447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-81885c6b-6889-4043-ad8d-59fb88097130 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.217447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.217447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.217447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.217447] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81885c6b-6889-4043-ad8d-59fb88097130',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.695997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.695997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.695997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.695997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.696250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.696250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.696250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.696395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.696482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.696569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.696716] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.696808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.696868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.697021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.697170] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.697264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.697323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.697461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.697538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.697632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.697735] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.717170] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.718106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.718221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.719310] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81885c6b-6889-4043-ad8d-59fb88097130 with status ACTIVE [ 964.719482] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.719630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.719699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.719910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.720033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.720216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.720313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.720376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.720596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.721837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.722043] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.722180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.722395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.722923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.722923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.723095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81885c6b-6889-4043-ad8d-59fb88097130 is going to be updated. [ 964.747579] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.747579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.747579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.747788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.747819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.748012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81885c6b-6889-4043-ad8d-59fb88097130" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.154796] env[65469]: INFO networking_nsxv3.common.synchronization [None req-4cb1aa28-1d7a-4b31-a159-b7c48a487288 None None] Enqueued Resource ID: 9fb81181-5e99-45cd-b116-3b2baf95509c with Priority: HIGHEST for action port [ 965.155460] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fb81181-5e99-45cd-b116-3b2baf95509c with Priority: HIGHEST for action port [ 965.155824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fb81181-5e99-45cd-b116-3b2baf95509c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.155911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fb81181-5e99-45cd-b116-3b2baf95509c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.155970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fb81181-5e99-45cd-b116-3b2baf95509c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.156240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fb81181-5e99-45cd-b116-3b2baf95509c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.156321] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb81181-5e99-45cd-b116-3b2baf95509c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.199548] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f107522e-6192-4b58-8a9d-bdf6cd660823: rpc.has_security_group_logging(os_id): False [ 965.220214] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.220371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.220467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.220732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.220827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.221045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.221149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.221212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.221359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.221436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.221668] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.221762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.221823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.221963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.222051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.222462] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.222462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.222462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.222703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.222703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.222703] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 965.224757] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.295049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.295049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.295049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.295049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.295399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.312720] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 965.659027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fb81181-5e99-45cd-b116-3b2baf95509c [ 965.659283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.660028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.660028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.660028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.660028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.660028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fb81181-5e99-45cd-b116-3b2baf95509c already deleted. [ 965.660028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fb81181-5e99-45cd-b116-3b2baf95509c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.728560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.730200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.730200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.730343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.730797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.730797] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be created. [ 965.772905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.773110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.773110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.773325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.774022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.790309] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: UNINITIALIZED for 2s [ 966.149020] env[65469]: INFO networking_nsxv3.common.synchronization [req-264bf983-4adc-4510-933f-bf3c2a3aff24 req-8c16655c-5b3e-4f9d-8e30-11ec11a8e567 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 966.149604] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 966.150144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.150144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.150144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.150408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.150584] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.150807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.150807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.150916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.150995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.151093] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.181063] env[65469]: INFO networking_nsxv3.common.synchronization [req-0f301a4e-b23e-4ab1-b091-b63aa949c36b req-22b0c401-6694-49d7-9de0-0bc125b054c5 tempest-ServerRescueTestJSON-1121830031 tempest-ServerRescueTestJSON-1121830031-project-member] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 966.181816] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 966.182385] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.182385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.182527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.184636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.184813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.184927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.184992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.186120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.186215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.186347] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.550587] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.550861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.550861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.551256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.551778] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.552095] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.552249] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.552483] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.552678] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.553064] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.553190] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.553309] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.553480] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.553599] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.553683] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.553830] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.580956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.581242] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.581396] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.581584] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.581992] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-b4fe6223-a282-43b1-9e82-9092df6ce480 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.582333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.582333] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.582801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.585294] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4fe6223-a282-43b1-9e82-9092df6ce480',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.654489] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.654874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.654874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.655165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.655366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.655598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.655764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.655896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.656175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.656347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.656482] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a already deleted. [ 966.656595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.689659] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.089402] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.089764] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.089996] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.090329] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.090511] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.090668] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port b4fe6223-a282-43b1-9e82-9092df6ce480 not found, creating... [ 967.090940] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.091114] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.091232] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.091478] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.091614] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.092759] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.092759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.092759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.092759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.092759] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.092759] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: b4fe6223-a282-43b1-9e82-9092df6ce480 is going to be created. [ 967.117345] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.117555] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.118612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.118612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.118612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.118612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.192300] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.326985] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 967.327238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.694817] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.694979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.695069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.695288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.695374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.695474] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be updated. [ 967.748283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.748450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.748549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.748779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.748953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.762084] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 967.803495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 967.803890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.803890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.804143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.804337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.804456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.804518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.804681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.804770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.804847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.804943] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [req-264bf983-4adc-4510-933f-bf3c2a3aff24 req-2a9dbc43-a215-46c7-8acb-113b6a75c1b0 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [req-264bf983-4adc-4510-933f-bf3c2a3aff24 req-2a9dbc43-a215-46c7-8acb-113b6a75c1b0 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [req-264bf983-4adc-4510-933f-bf3c2a3aff24 req-2a9dbc43-a215-46c7-8acb-113b6a75c1b0 service nova] Enqueued Resource ID: b4fe6223-a282-43b1-9e82-9092df6ce480 with Priority: HIGHEST for action port [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 967.908204] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fe6223-a282-43b1-9e82-9092df6ce480 with Priority: HIGHEST for action port [ 967.908204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.908204] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.908204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.908204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.908204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.912048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.912048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4fe6223-a282-43b1-9e82-9092df6ce480 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.912048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.912048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.912048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.912048] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4fe6223-a282-43b1-9e82-9092df6ce480',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.309502] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.372031] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.372208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.372374] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.373876] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4fe6223-a282-43b1-9e82-9092df6ce480 with status ACTIVE [ 968.373876] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.373876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.373876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.374079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.374079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.374228] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.374324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.374383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.374625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.374698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.375447] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.375931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.375931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.375931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.375931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.376123] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4fe6223-a282-43b1-9e82-9092df6ce480 is going to be updated. [ 968.405645] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.405817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.405899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.406162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.406316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.406510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4fe6223-a282-43b1-9e82-9092df6ce480" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.811291] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8608a4da-285d-4dc3-aa08-db64404925d5: rpc.has_security_group_logging(os_id): False [ 968.833967] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.834080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.834132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.834356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.834448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.834732] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.834896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.834896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.835587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.835587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.835587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be created. [ 968.878507] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.912603] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.912881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.912881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.913132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.913535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.929895] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 969.383592] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.383994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.383994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.383994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.384323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.384323] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be created. [ 969.410765] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.410943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.410990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.411217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.411380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.421902] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: UNINITIALIZED for 2s [ 969.774456] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 969.774456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.115671] env[65469]: INFO networking_nsxv3.common.synchronization [req-fc7db235-3f43-4930-8ec4-07f77ecd9de3 req-84884d96-ec62-4e7e-8363-5f4cd0081bf6 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 970.115671] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGHEST for action security_group_members [ 970.115897] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.116026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.116091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.121144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.121456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.121525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.121868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.121868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.121868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.121974] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.625152] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.625956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.626202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.626547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.652957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.655018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.655018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.655018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.655018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.655018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.655018] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c is going to be updated. [ 970.702207] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.702207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.702207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.702207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.702207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.711558] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: IN_PROGRESS for 2s [ 970.787308] env[65469]: INFO networking_nsxv3.common.synchronization [req-59db4010-3619-4113-b1b5-5d64596945b8 req-367f5c69-e33a-4930-9f16-1f7f9b880140 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 970.787308] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 970.787308] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.787308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.787308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.787308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.787308] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.787308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.787308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.788833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.789089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.789305] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.944774] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 970.945184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.023912] env[65469]: INFO networking_nsxv3.common.synchronization [req-3cd73292-a0db-431d-9c68-7b888ebefc38 req-cb74055f-ea60-4b5e-96d7-6b7c863c3e89 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 971.024305] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 971.024651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.024747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.294779] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.433544] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 971.433544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.433544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.433544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.433793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.433793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.433898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.434472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.434472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.434472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.434472] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.797977] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.938330] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.305415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.305415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.305415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.305415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.305415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.305415] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 972.352843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.353066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.353066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.353301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.353596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.363771] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 972.441319] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 972.465263] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.465481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.465481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.465664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.465751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.465988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.466091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.466153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.466296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.466407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.466444] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be created. [ 972.541209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.541209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.541209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.541209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.541209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.559186] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 972.729558] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c in Status: SUCCESS [ 972.729808] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c deletion is rescheduled due to dependency. [ 972.729934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.815046] env[65469]: INFO networking_nsxv3.common.synchronization [req-fe2e4e59-7e62-4ea0-8abb-f7382a4e2786 req-43e46b73-89ad-4aeb-b64d-530d58732a46 tempest-ImagesTestJSON-1431127217 tempest-ImagesTestJSON-1431127217-project-member] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 973.815635] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGHEST for action security_group_members [ 973.816085] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.816257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.816343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.817474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.819216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.819376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.819466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.819794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.819959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.820875] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.324821] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.324821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.324821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.325085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.325085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.325578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.325704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.325853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.326067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.326155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.326456] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be updated. [ 974.367892] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.367892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.367892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.367892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.367892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.378215] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: IN_PROGRESS for 2s [ 974.378943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 974.379489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.379489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.379618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.379712] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.379953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.379953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.380066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.380143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.380259] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.574233] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 974.574453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.883052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.883052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.883660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.883660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.883660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.883660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.884191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.884191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.884191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.884191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.884191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 974.913021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.913379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.913379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.913521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.913666] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.923430] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 976.390355] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d in Status: SUCCESS [ 976.390678] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d deletion is rescheduled due to dependency. [ 976.390721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.933840] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 976.934154] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 deletion is rescheduled due to dependency. [ 976.934330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.817718] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.817718] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 979.596321] env[65469]: INFO networking_nsxv3.common.synchronization [req-cc27cf64-be28-4872-8e1b-fd7a63231666 req-b743e2cf-9b28-4de5-ae39-8cd7ea5852ef tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 979.596321] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 979.596730] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.596730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.596730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.596899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.597083] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.597182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.597289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.597453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.597565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.597689] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.101270] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.604182] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.819400] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbd7c123-e039-47c2-86c0-01a4446fa62e req-8117b4c0-737f-4f78-920c-9c4358ae98e0 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 980.819461] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 980.819752] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.819867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.819929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.820142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.820289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.820384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.820441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.820623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.820692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.820772] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.108082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.108082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.108082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.108082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.108082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.108082] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 981.137397] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.137718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.137895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.138288] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.138775] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.139033] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.139234] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.139870] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.139870] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.141118] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.141118] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.141118] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.141118] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.141118] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.141370] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.142355] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.144025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.144165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.144256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.144484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.144680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.156583] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 981.167127] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.167372] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.167569] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.167827] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.168322] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.168620] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.168849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.169339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.169605] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e07bb0-1d0b-41f0-9719-c82e46ddf64a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.322789] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.673239] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.673473] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.673602] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.673906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.674081] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.674236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port f6e07bb0-1d0b-41f0-9719-c82e46ddf64a not found, creating... [ 981.674604] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.674861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.674980] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.675225] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.675366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.675663] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.675818] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.675931] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.676168] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.676304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.676442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: f6e07bb0-1d0b-41f0-9719-c82e46ddf64a is going to be created. [ 981.699656] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.699945] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.700195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.700475] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.700837] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.701130] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.826283] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.328877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.329186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.329186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.329352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.329457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.329588] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 982.363379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.363592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.363592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.363798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.363944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.375871] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 982.447545] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbd7c123-e039-47c2-86c0-01a4446fa62e req-44d283e6-dbc6-4125-aa3c-db2dc3907370 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 982.447736] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbd7c123-e039-47c2-86c0-01a4446fa62e req-44d283e6-dbc6-4125-aa3c-db2dc3907370 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 982.447879] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbd7c123-e039-47c2-86c0-01a4446fa62e req-44d283e6-dbc6-4125-aa3c-db2dc3907370 service nova] Enqueued Resource ID: f6e07bb0-1d0b-41f0-9719-c82e46ddf64a with Priority: HIGHEST for action port [ 982.448533] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 982.448775] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 982.448892] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6e07bb0-1d0b-41f0-9719-c82e46ddf64a with Priority: HIGHEST for action port [ 982.449333] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.449397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.449433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.449643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.449705] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.450724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.450835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.451489] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.451489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.451489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.451489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.451489] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e07bb0-1d0b-41f0-9719-c82e46ddf64a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.953130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.953329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.953577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6e07bb0-1d0b-41f0-9719-c82e46ddf64a with status ACTIVE [ 982.953766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.953922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.953960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.954195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.954542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.954736] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.954818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.954870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.955095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.955201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.955359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.955453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.955636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.955803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.955930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.955976] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6e07bb0-1d0b-41f0-9719-c82e46ddf64a is going to be updated. [ 982.977912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.979847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.979847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.979847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.979847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.979847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6e07bb0-1d0b-41f0-9719-c82e46ddf64a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.166549] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 983.166752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.387354] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 984.387715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.387869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.388261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.388410] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.388738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.388862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.389072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.389181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.389320] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.892413] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.394980] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.900061] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.900061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.900376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.900484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.900606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.900791] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 985.931907] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.932127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.932221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.932455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.932596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.941935] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 986.043014] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e0fbc2e9-6db5-49b1-8125-a7d7eebcb575 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: 562a123b-9d25-46da-a0e2-ded810aaec19 with Priority: HIGHEST for action security_group_rules [ 986.043843] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562a123b-9d25-46da-a0e2-ded810aaec19 with Priority: HIGHEST for action security_group_rules [ 986.043843] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562a123b-9d25-46da-a0e2-ded810aaec19 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.043843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.043843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.044174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.044212] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562a123b-9d25-46da-a0e2-ded810aaec19',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.133029] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e0267a69-4bd7-40ff-a91d-c4d0f2f62734 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: 562a123b-9d25-46da-a0e2-ded810aaec19 with Priority: HIGHEST for action security_group_rules [ 986.133355] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562a123b-9d25-46da-a0e2-ded810aaec19 with Priority: HIGHEST for action security_group_rules [ 986.133575] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562a123b-9d25-46da-a0e2-ded810aaec19 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.133679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.570038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.570520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.570520] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562a123b-9d25-46da-a0e2-ded810aaec19 already deleted. [ 986.570520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.570820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.570820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570979] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562a123b-9d25-46da-a0e2-ded810aaec19',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.092875] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.093038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.093106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.093324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.093414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.093499] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562a123b-9d25-46da-a0e2-ded810aaec19 already deleted. [ 987.093580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562a123b-9d25-46da-a0e2-ded810aaec19" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.955595] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 987.956043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.956190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.956457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.956665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.956794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.956864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.957051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.957157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.957253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.957348] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.461267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.461514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.461660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.463147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.463395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.463518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.463586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.463762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.464602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.464696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.464944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.465317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.465317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.465485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.465726] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.467570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.467658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.468532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.468532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.468532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.468532] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.973202] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 988.995542] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.995723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.995769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.995959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.996079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.996250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.996345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.996402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.996561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.996649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.996852] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.996970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.997053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.997233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.997308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.997506] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.997599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.997659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.997822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.997909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.998050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 989.069656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.069656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.069656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.069656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.069656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.089047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 989.190247] env[65469]: INFO networking_nsxv3.common.synchronization [req-d05ee07e-e3b8-4fff-a3b3-54e4f4f16c53 req-cecadc10-c00b-4af0-a99a-010b1a1313b3 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 989.190732] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 989.190783] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.191304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.191304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.191304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.191532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.191532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.191662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.191780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.191858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.192403] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.695590] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.695590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.695736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.696653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.696653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.696860] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.696969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.697039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.697224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.697304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.697394] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 989.729477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.729685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.729803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.729988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.730156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.754573] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 990.029413] env[65469]: INFO networking_nsxv3.common.synchronization [req-03792c3a-3b2a-491a-a036-36a6211ae084 req-9d28b324-1223-4178-9b79-8e03e09ecb37 tempest-InstanceActionsNegativeTestJSON-476875174 tempest-InstanceActionsNegativeTestJSON-476875174-project-member] Enqueued Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 990.030547] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 990.031930] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.031930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.031930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.032660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.032660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.032660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.032775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.032940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.033093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.033223] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.396915] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.397140] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.397269] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.397612] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.397878] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.398047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.398166] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.398389] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.398532] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.398739] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.398854] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.398963] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.399084] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.399222] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.399299] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.399429] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.419227] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.419415] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.419570] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.419772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.420130] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-fb1f939c-65cb-480a-8202-af6401f35ef1 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.420307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.420428] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.420782] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.420921] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1f939c-65cb-480a-8202-af6401f35ef1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.535932] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.536119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.536194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.536410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.536626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.536869] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.537058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.537134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.537284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.537355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.537448] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 already deleted. [ 990.537537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.926310] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.926565] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.926694] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.926985] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.927152] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.927305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port fb1f939c-65cb-480a-8202-af6401f35ef1 not found, creating... [ 990.927565] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.927791] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.927953] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.928270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.928356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.928622] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.928797] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.928918] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.929148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.929283] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.929422] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: fb1f939c-65cb-480a-8202-af6401f35ef1 is going to be created. [ 990.948636] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.948857] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.948974] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.949222] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.949454] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.949672] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.103762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 991.103762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.666447] env[65469]: INFO networking_nsxv3.common.synchronization [req-03792c3a-3b2a-491a-a036-36a6211ae084 req-8b0ba1b5-039d-4dc5-a2b6-16c2f89c6fd4 service nova] Enqueued Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_rules [ 991.666658] env[65469]: INFO networking_nsxv3.common.synchronization [req-03792c3a-3b2a-491a-a036-36a6211ae084 req-8b0ba1b5-039d-4dc5-a2b6-16c2f89c6fd4 service nova] Enqueued Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 991.667348] env[65469]: INFO networking_nsxv3.common.synchronization [req-03792c3a-3b2a-491a-a036-36a6211ae084 req-8b0ba1b5-039d-4dc5-a2b6-16c2f89c6fd4 service nova] Enqueued Resource ID: fb1f939c-65cb-480a-8202-af6401f35ef1 with Priority: HIGHEST for action port [ 991.667673] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_rules [ 991.667834] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 991.668164] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1f939c-65cb-480a-8202-af6401f35ef1 with Priority: HIGHEST for action port [ 991.668324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.668483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.668579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.668895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.669019] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.670046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.670169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.670239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.670413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.670607] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.671254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.671254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.671254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.671407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.671551] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.672781] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb1f939c-65cb-480a-8202-af6401f35ef1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.672948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.673085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.673296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.673409] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1f939c-65cb-480a-8202-af6401f35ef1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.764621] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 991.764809] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 991.764930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.175583] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.176745] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.176745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.177242] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb1f939c-65cb-480a-8202-af6401f35ef1 with status ACTIVE [ 992.177432] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.177548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.177614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.177815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.177918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.178126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.178205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.178293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.178538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.178538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.178738] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.178843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.178899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.179072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.179142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.179251] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb1f939c-65cb-480a-8202-af6401f35ef1 is going to be updated. [ 992.201570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.201830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.201830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.201995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.202148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.202307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb1f939c-65cb-480a-8202-af6401f35ef1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.677600] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.180613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.180613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.180613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.181102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.181102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.181102] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 is going to be created. [ 993.207164] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.207302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.207385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.207595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.207783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220331] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: UNINITIALIZED for 2s [ 993.863286] env[65469]: INFO networking_nsxv3.common.synchronization [req-dbcee55c-fc09-4297-96ea-51c405e32b9c req-413abc86-a025-434a-87eb-8301ab00150d tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 993.863977] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 993.864398] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.864519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.864585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.864848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.865096] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.865210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.865270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.865430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.865518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.865784] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.080937] env[65469]: INFO networking_nsxv3.common.synchronization [req-f25a3f6c-301b-4316-9c94-f2f0ddeb48b1 req-319dd94a-9ab0-4bec-82fd-7243a548a8bc tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 994.081477] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 994.081794] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.081969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.081969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.082593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.082823] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.082922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.083044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.083167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.083252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.083329] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.369353] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.422625] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.422625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.422848] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.423112] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.423385] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.423545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.423664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.423882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.424165] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.424491] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.424620] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.424774] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.424868] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.424978] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.425098] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.425231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.450062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.450258] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.450366] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.450553] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.450944] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-350dbf41-cc41-4937-9710-b210b521b3b2 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.451146] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.451268] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.451601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.451806] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350dbf41-cc41-4937-9710-b210b521b3b2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.503808] env[65469]: INFO networking_nsxv3.common.synchronization [req-9a9960a4-38b2-4f99-8cbc-720f9132e0ed req-e4981916-3d25-4dbd-ab4c-85e25d7506a8 tempest-ServerRescueTestJSON-1121830031 tempest-ServerRescueTestJSON-1121830031-project-member] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 994.504146] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGHEST for action security_group_members [ 994.505020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.505020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.505020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.505020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.505251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.505251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.505334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.505454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.505543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.505665] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.585386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.585557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.585616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.586491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.607114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.607405] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.607520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.607593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.607783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.607883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.607973] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 994.632759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.632919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.632990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.633215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.633361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.642738] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 994.873054] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.954806] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.954806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.954806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.955154] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.955242] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.955407] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 350dbf41-cc41-4937-9710-b210b521b3b2 not found, creating... [ 994.956490] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.956490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.956490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.956490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.956718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.956884] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.957057] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.957170] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.957374] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.957501] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.957674] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 350dbf41-cc41-4937-9710-b210b521b3b2 is going to be created. [ 994.979354] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.979573] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.979699] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.979982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.980250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.980639] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.007514] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.007671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.007735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.010269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.010405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.010649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.010780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.010845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.012844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.012844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.012844] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be updated. [ 995.040491] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.040656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.040735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.041094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.041145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.051331] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: IN_PROGRESS for 2s [ 995.230478] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: SUCCESS [ 995.230783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.231871] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.231871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.232555] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.376695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.377071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.377071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.377260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.377421] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.377554] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 995.412334] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.412576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.412576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.412800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.412951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.422527] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 995.722598] env[65469]: INFO networking_nsxv3.common.synchronization [req-f25a3f6c-301b-4316-9c94-f2f0ddeb48b1 req-dec01df4-f89a-41f8-8173-9bd27bfc2f15 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 995.722737] env[65469]: INFO networking_nsxv3.common.synchronization [req-f25a3f6c-301b-4316-9c94-f2f0ddeb48b1 req-dec01df4-f89a-41f8-8173-9bd27bfc2f15 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 995.722889] env[65469]: INFO networking_nsxv3.common.synchronization [req-f25a3f6c-301b-4316-9c94-f2f0ddeb48b1 req-dec01df4-f89a-41f8-8173-9bd27bfc2f15 service nova] Enqueued Resource ID: 350dbf41-cc41-4937-9710-b210b521b3b2 with Priority: HIGHEST for action port [ 995.723562] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 995.723833] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 995.723833] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350dbf41-cc41-4937-9710-b210b521b3b2 with Priority: HIGHEST for action port [ 995.724160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.724296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.724387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.724573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.724717] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.725636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.725735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.727375] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-350dbf41-cc41-4937-9710-b210b521b3b2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.727375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.727375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.727375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.727375] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350dbf41-cc41-4937-9710-b210b521b3b2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.735669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.735669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.735669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.736691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.736691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.736691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.736691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.737237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.737237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.737237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.737393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.737444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.737913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.737913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.737913] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.737913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.737913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.738112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.738669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.738669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.738669] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.228446] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.228665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.231051] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 350dbf41-cc41-4937-9710-b210b521b3b2 with status ACTIVE [ 996.231266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.231372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.231431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.231764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.232101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.232172] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.232332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.232332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.232438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.232517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.232703] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.232816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.232896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.232976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.233053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.233143] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 350dbf41-cc41-4937-9710-b210b521b3b2 is going to be updated. [ 996.240924] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a78cf656-0352-46dc-9e26-9fd8a6ca6ce0: rpc.has_security_group_logging(os_id): False [ 996.263251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.263458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.263458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.263656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.263794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.263953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-350dbf41-cc41-4937-9710-b210b521b3b2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.266045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.266107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.266189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.266403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.266572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.266801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.267155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.267972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.268176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.268280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.268536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.268703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.268794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.268976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.269098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.269333] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.269473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.269608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.269734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.269818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.269905] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 is going to be created. [ 996.369668] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.369850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.370029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.370157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.370343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.384039] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: IN_PROGRESS for 2s [ 996.653441] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 996.653632] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 deletion is rescheduled due to dependency. [ 996.653748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.653987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.654227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.654415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.654533] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.654598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.654751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.654833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.654926] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.066895] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e in Status: SUCCESS [ 997.066895] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e deletion is rescheduled due to dependency. [ 997.066895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.157339] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.431565] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 997.431890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.660444] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.163854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.164119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.164119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.164377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.164428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.164526] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 998.207974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.208185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.208237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.208493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.208692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.220456] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 998.400691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: SUCCESS [ 998.401088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.881952] env[65469]: INFO networking_nsxv3.common.synchronization [req-af846367-1770-4d63-92b4-b74408f3e305 req-3c3367eb-7151-4a70-9ab3-3ad82be44800 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 999.882615] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 999.882805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.882919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.882984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.883304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.883450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.883557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.883701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.883859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.883859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.884051] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.232073] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1000.232073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.232073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.232649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.232700] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.232897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.233021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.233260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.233397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.233506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.233605] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.387023] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.641950] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e68dff80-e2c8-40ed-93ad-a56b877334de tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1000.642095] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1000.642326] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.642448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.642511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.642711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.642883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.642985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.643125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.643248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.643333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.643424] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.735768] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.736022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.889447] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.145386] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.393512] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.393512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.393512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.393512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.393512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.393512] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 1001.426378] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.426532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.426625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.426833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.426986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.439426] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 1001.647729] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.150468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.150864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.150864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.151123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.151250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.151362] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1002.182421] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.182575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.182648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.182863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.183025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.192303] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1002.733934] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.733934] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.733934] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.734174] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.734335] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.734482] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.734595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.735030] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.735030] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.735145] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.735251] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.735359] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.735595] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.735595] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.735711] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.736141] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.754815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.754992] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.755815] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.755815] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.755815] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-67160315-db29-4a41-a580-736b4958317f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.755815] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.756071] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.756297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.756460] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67160315-db29-4a41-a580-736b4958317f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.076382] env[65469]: INFO networking_nsxv3.common.synchronization [req-020969c7-8d15-44e0-a0f6-970590c4dbb5 req-4e801033-7c0c-4e2c-a5db-8bc0261300be tempest-InstanceActionsNegativeTestJSON-476875174 tempest-InstanceActionsNegativeTestJSON-476875174-project-member] Enqueued Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 1003.076918] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGHEST for action security_group_members [ 1003.077353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.077482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.077545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.077749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.077891] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.078026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.078092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.078416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.078416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.078416] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.258681] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.259179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.259179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.259179] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.259982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.260502] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 67160315-db29-4a41-a580-736b4958317f not found, creating... [ 1003.261121] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.261633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.261633] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.262379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.262379] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.262379] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.262735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.262735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.262922] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.263083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.263227] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 67160315-db29-4a41-a580-736b4958317f is going to be created. [ 1003.287110] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.287661] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.288076] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.288884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.289139] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.289916] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.450926] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 1003.451698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.580489] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.581298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.581298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.581298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.581298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.581298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.581691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.581691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.581691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.581808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.581909] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 is going to be updated. [ 1003.611377] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.611524] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.611606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.611826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.612045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.623942] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: IN_PROGRESS for 2s [ 1003.699636] env[65469]: INFO networking_nsxv3.common.synchronization [req-22a169f2-3702-4a1c-b42f-a16489c2617e req-c688360b-6766-4cf5-b40e-0c7269fd71fe tempest-ServersAdminNegativeTestJSON-1911609592 tempest-ServersAdminNegativeTestJSON-1911609592-project-member] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1003.700660] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1003.701159] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.701289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.701366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.701629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.701800] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.702048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.702148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.702339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.702435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.702537] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.006430] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9e26537-ee1a-4018-8e17-1f35a9598f7b req-29ceeda2-6442-471b-a399-0b8532c06137 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1004.006627] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9e26537-ee1a-4018-8e17-1f35a9598f7b req-29ceeda2-6442-471b-a399-0b8532c06137 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1004.006687] env[65469]: INFO networking_nsxv3.common.synchronization [req-f9e26537-ee1a-4018-8e17-1f35a9598f7b req-29ceeda2-6442-471b-a399-0b8532c06137 service nova] Enqueued Resource ID: 67160315-db29-4a41-a580-736b4958317f with Priority: HIGHEST for action port [ 1004.007222] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1004.007361] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1004.007837] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67160315-db29-4a41-a580-736b4958317f with Priority: HIGHEST for action port [ 1004.008116] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.008222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.008438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.008509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.008689] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-67160315-db29-4a41-a580-736b4958317f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.008790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.008851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.009053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.009133] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67160315-db29-4a41-a580-736b4958317f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.204159] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 4s [ 1004.204811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.204811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.204811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.204993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.205312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.205431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.205638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.206100] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 already deleted. [ 1004.206100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.279862] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.279862] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.280318] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.280318] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.280611] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.280848] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.281438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.282337] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.282499] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.282715] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.282865] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.283090] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.283247] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.283567] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.283567] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.283669] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.308389] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.308565] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.308624] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.308841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.309231] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-e2578c8a-080a-4a93-840a-bfcaa77dff2e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.309445] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.309577] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.309946] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.310386] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2578c8a-080a-4a93-840a-bfcaa77dff2e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.517252] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67160315-db29-4a41-a580-736b4958317f with status ACTIVE [ 1004.517252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.517441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.517441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.517621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.517715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.517917] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.518055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.518103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.518309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.518393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.518575] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.518669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.518752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.518901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.518979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.519078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67160315-db29-4a41-a580-736b4958317f is going to be updated. [ 1004.539022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.539244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.539244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.539453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.539553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.539708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67160315-db29-4a41-a580-736b4958317f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.812496] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.812882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.812882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.813157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.813321] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.813483] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port e2578c8a-080a-4a93-840a-bfcaa77dff2e not found, creating... [ 1004.813749] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.813905] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.814044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.814314] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.814458] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.814741] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.814899] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.815029] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.815239] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.815374] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.815511] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: e2578c8a-080a-4a93-840a-bfcaa77dff2e is going to be created. [ 1004.841334] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.841544] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.841668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.842016] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.842263] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.842503] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.582222] env[65469]: INFO networking_nsxv3.common.synchronization [req-22a169f2-3702-4a1c-b42f-a16489c2617e req-8fc7ddba-7011-46e7-9d47-5f991f0c2dc9 service nova] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_rules [ 1005.582497] env[65469]: INFO networking_nsxv3.common.synchronization [req-22a169f2-3702-4a1c-b42f-a16489c2617e req-8fc7ddba-7011-46e7-9d47-5f991f0c2dc9 service nova] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1005.582777] env[65469]: INFO networking_nsxv3.common.synchronization [req-22a169f2-3702-4a1c-b42f-a16489c2617e req-8fc7ddba-7011-46e7-9d47-5f991f0c2dc9 service nova] Enqueued Resource ID: e2578c8a-080a-4a93-840a-bfcaa77dff2e with Priority: HIGHEST for action port [ 1005.583075] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_rules [ 1005.583214] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1005.583311] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2578c8a-080a-4a93-840a-bfcaa77dff2e with Priority: HIGHEST for action port [ 1005.583583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.583707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.583774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.584133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.584247] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.585066] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.585233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.585554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.585764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.587440] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.587440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.587440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.587440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.587440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.587440] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.588276] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2578c8a-080a-4a93-840a-bfcaa77dff2e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.588522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.588522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.588723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.589373] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2578c8a-080a-4a93-840a-bfcaa77dff2e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.634872] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 in Status: SUCCESS [ 1005.638031] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 deletion is rescheduled due to dependency. [ 1005.638031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.048257] env[65469]: INFO networking_nsxv3.common.synchronization [None req-9756a0b5-e756-44c0-9b5c-b4bca0c8dd46 None None] Enqueued Resource ID: 898f6cc3-ea1b-4609-8d91-812ace225005 with Priority: HIGHEST for action port [ 1006.048795] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898f6cc3-ea1b-4609-8d91-812ace225005 with Priority: HIGHEST for action port [ 1006.049138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-898f6cc3-ea1b-4609-8d91-812ace225005 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.049264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-898f6cc3-ea1b-4609-8d91-812ace225005" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.049327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-898f6cc3-ea1b-4609-8d91-812ace225005" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.049912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-898f6cc3-ea1b-4609-8d91-812ace225005" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.049912] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('898f6cc3-ea1b-4609-8d91-812ace225005',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.090835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.090835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.091061] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.092552] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2578c8a-080a-4a93-840a-bfcaa77dff2e with status ACTIVE [ 1006.093478] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.093578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.093616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.093793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.093876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.094135] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.094215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.094249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.094388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.094462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.094637] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.094894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.094894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.095035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.095035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.095902] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2578c8a-080a-4a93-840a-bfcaa77dff2e is going to be updated. [ 1006.121293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.121293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.121293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.121293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.121619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.121619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2578c8a-080a-4a93-840a-bfcaa77dff2e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.227027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1006.227027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.227027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.227027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.227216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.227290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.227324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.227458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.227541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.227627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.227787] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.227868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.227932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.228085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.228225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.228318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.228379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.228514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.228590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.228665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.229242] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.230468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.230468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.230468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.230661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.230696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.230895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.231032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.231125] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.551486] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 898f6cc3-ea1b-4609-8d91-812ace225005 [ 1006.551622] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.551772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.551860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.552237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.552237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.552237] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:898f6cc3-ea1b-4609-8d91-812ace225005 already deleted. [ 1006.552433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-898f6cc3-ea1b-4609-8d91-812ace225005" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.597743] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.732515] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6f27ff1-776e-4a70-90a6-ebc268939e44: rpc.has_security_group_logging(os_id): False [ 1006.734108] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.753132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.753858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.753858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.753858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.753858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.753858] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.754105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.754105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.756996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.756996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.756996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.756996] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1006.827564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.827564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.827564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.827564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.827564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.844643] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1007.100250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.101186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.101186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.102024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.102024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.102024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be created. [ 1007.132481] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.133132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.135120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.135120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.135120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.145327] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: UNINITIALIZED for 2s [ 1007.236696] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.740156] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.740156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.740156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.740486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.740486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.740486] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1007.772327] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.772544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.772655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.772869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.773530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.787859] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1008.862299] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1008.862664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.862704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.862933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.863035] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.898088] env[65469]: INFO networking_nsxv3.common.synchronization [None req-97861a7c-e1ff-4f68-828b-9bc509edff88 None None] Enqueued Resource ID: d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3 with Priority: HIGHEST for action port [ 1008.898088] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3 with Priority: HIGHEST for action port [ 1008.898837] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.899236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.899634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.900315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.900621] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.923066] env[65469]: INFO networking_nsxv3.common.synchronization [req-ef31eb3e-1544-487b-a13c-872b70cbc907 req-7a2a7358-521d-49b3-ba60-03d3cc6db5fe tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 1008.923328] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 1008.923909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.924073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.924146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.924349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.924551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.924624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.924675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.924789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.924870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.924965] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.991290] env[65469]: INFO networking_nsxv3.common.synchronization [req-204cfca4-d433-44b0-b30b-56e7948f1b32 req-0aaa0470-822e-41e3-a90c-afeccbcd7e8d tempest-ServersWithSpecificFlavorTestJSON-500812745 tempest-ServersWithSpecificFlavorTestJSON-500812745-project-member] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 1008.991290] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGHEST for action security_group_members [ 1008.991402] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.992032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.992032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.992032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.992032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.992032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.992277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.992277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.992337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.992414] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.158370] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1009.158370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.158570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.158761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.158956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.159088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.159154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.159310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.159394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.159479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.159569] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.365920] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.366075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.406359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3 [ 1009.406359] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.406359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.406359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.406359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.406359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.406359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3 already deleted. [ 1009.406359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7fff2d6-6ee8-4ac9-9e52-c7ceceb849e3" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.431133] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.499623] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.499623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.499623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.499923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.499923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.500084] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.500160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.500196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.500730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.500730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.500730] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be updated. [ 1009.531987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.532208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.533997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.533997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.533997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.542225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: IN_PROGRESS for 2s [ 1009.662096] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.662326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.662326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.662487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.662943] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.662943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.662943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.663169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.663169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.663169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.663317] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.663411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.664080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.664080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.664080] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.664080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.664080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.664080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.664347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.664347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.664347] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.797676] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1009.798072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.798072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.798238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.798417] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.799483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.799601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.800597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.800704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.800804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.801151] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.933030] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.072375] env[65469]: INFO networking_nsxv3.common.synchronization [req-975d527b-dbb4-4112-b0bc-8bf87b1e64e1 req-101a7723-9065-4587-b93d-1776e7c5add9 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1010.073223] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1010.073972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.074172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.074284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.074577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.074884] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.075151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.075229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.075420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.075513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.075613] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.170828] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ff0417e-ec9b-4d09-9e53-7e07d24399c0: rpc.has_security_group_logging(os_id): False [ 1010.188583] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.188741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.188813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.189040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.189135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.189712] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.189712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.189712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.189889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.189889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.190312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.190312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.190312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.190446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.190923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.190923] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.191766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.191808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.192070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.192129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.192318] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be created. [ 1010.250424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.250607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.250742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.250920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.251134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.262671] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1010.306603] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.306603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.306786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.306964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.307047] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.307364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.307364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.307446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.307504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.307612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.307764] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.307910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.307961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.308104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.308817] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.308817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.308817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.310095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.310169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.310820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.310820] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.435381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.435582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.435657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.435860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.435954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.436048] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 1010.471261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.471261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.471261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.471261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.471261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.481446] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 1010.490735] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.490987] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.491161] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.491773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.491773] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.492028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.492164] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.492422] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.492575] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.492778] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.492892] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.494067] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.494067] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.494067] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.494067] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.494067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.516216] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.516216] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.516216] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.516216] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.516723] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.516939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.517077] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.517423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.517608] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc82204-e4b7-40e8-a8b2-714a5ee41b7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.577792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.577792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.577930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.578301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.578406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.578574] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.578711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.578800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.578989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.579133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.579266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1010.629828] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.629978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.630048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.630265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.630413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.640587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1010.814631] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6f27ff1-776e-4a70-90a6-ebc268939e44: rpc.has_security_group_logging(os_id): False [ 1010.836090] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836090] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836090] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.837167] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.837167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.837167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.837700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.838395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.840324] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1010.922187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.922187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.922187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.922348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.922454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.939691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1011.020686] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.021047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.021162] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.021507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.021681] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.021868] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port ffc82204-e4b7-40e8-a8b2-714a5ee41b7b not found, creating... [ 1011.022292] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.026026] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.026026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.026026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: ffc82204-e4b7-40e8-a8b2-714a5ee41b7b is going to be created. [ 1011.056573] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.056863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.056930] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.057288] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.057629] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.057871] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.552895] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 641bf348-fb8f-499f-a944-4cb315e55733 in Status: SUCCESS [ 1011.553125] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 deletion is rescheduled due to dependency. [ 1011.553271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.722157] env[65469]: INFO networking_nsxv3.common.synchronization [req-975d527b-dbb4-4112-b0bc-8bf87b1e64e1 req-e0c22e07-edb9-4f92-8346-3113c3405ff8 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 1011.722389] env[65469]: INFO networking_nsxv3.common.synchronization [req-975d527b-dbb4-4112-b0bc-8bf87b1e64e1 req-e0c22e07-edb9-4f92-8346-3113c3405ff8 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1011.722605] env[65469]: INFO networking_nsxv3.common.synchronization [req-975d527b-dbb4-4112-b0bc-8bf87b1e64e1 req-e0c22e07-edb9-4f92-8346-3113c3405ff8 service nova] Enqueued Resource ID: ffc82204-e4b7-40e8-a8b2-714a5ee41b7b with Priority: HIGHEST for action port [ 1011.723159] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 1011.723295] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1011.723392] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc82204-e4b7-40e8-a8b2-714a5ee41b7b with Priority: HIGHEST for action port [ 1011.723662] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.723777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.723858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.724132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.724218] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.725659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.725749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.725988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.726080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.726165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.726331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.726414] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc82204-e4b7-40e8-a8b2-714a5ee41b7b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.227909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228291] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffc82204-e4b7-40e8-a8b2-714a5ee41b7b with status ACTIVE [ 1012.228479] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.228881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.228984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.229169] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.229258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.230450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.230450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.230450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.230450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.230450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.230450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.230450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffc82204-e4b7-40e8-a8b2-714a5ee41b7b is going to be updated. [ 1012.252450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.252602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.252743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.252868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.253017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.253177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc82204-e4b7-40e8-a8b2-714a5ee41b7b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.275985] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1012.275985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.492319] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 1012.492319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.585427] env[65469]: INFO networking_nsxv3.common.synchronization [req-debb39ab-8aca-4ced-b502-3c7b231b5aca req-2d0d9ce2-f133-408f-8170-d227d82e5705 tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1012.586705] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1012.586973] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.587146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.587237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.587467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.587649] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.587791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.587877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.588076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.588168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.588287] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.649809] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1012.650050] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 1012.650112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.650265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.650493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.650692] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.650798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.650896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.651064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.651147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.651247] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.913143] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.913372] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.913511] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.913801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.914250] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.914250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.914427] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.914585] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.914733] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.914989] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.915131] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.915242] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.915358] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.915471] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.915575] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.915708] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.938498] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.938831] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.939089] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.939255] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.939586] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-baefd685-e2f0-4a4a-b14d-35635e1adc4d taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.939806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.939892] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.940221] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.940360] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baefd685-e2f0-4a4a-b14d-35635e1adc4d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.954299] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1012.954530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.090461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.090632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.090706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.090960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.091071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.091271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.091369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.091432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.091585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.091660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.091763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1013.117683] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.117858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.117923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.118145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.118289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.130151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1013.154668] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.443668] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.444060] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.444202] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.444514] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.444664] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.444817] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port baefd685-e2f0-4a4a-b14d-35635e1adc4d not found, creating... [ 1013.445091] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.445253] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.445369] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.445583] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.445717] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.445990] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.446159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.446273] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.446474] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.446606] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.446741] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: baefd685-e2f0-4a4a-b14d-35635e1adc4d is going to be created. [ 1013.466323] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.466620] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.466744] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.467100] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.467386] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.467647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.658514] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [req-debb39ab-8aca-4ced-b502-3c7b231b5aca req-d98323d5-2bbc-45a9-a421-1ec08bbb179c service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [req-debb39ab-8aca-4ced-b502-3c7b231b5aca req-d98323d5-2bbc-45a9-a421-1ec08bbb179c service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [req-debb39ab-8aca-4ced-b502-3c7b231b5aca req-d98323d5-2bbc-45a9-a421-1ec08bbb179c service nova] Enqueued Resource ID: baefd685-e2f0-4a4a-b14d-35635e1adc4d with Priority: HIGHEST for action port [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1014.150284] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baefd685-e2f0-4a4a-b14d-35635e1adc4d with Priority: HIGHEST for action port [ 1014.150284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.150284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.150756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.151075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.151340] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.152461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.152683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153078] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-baefd685-e2f0-4a4a-b14d-35635e1adc4d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.153331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.153758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.153931] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baefd685-e2f0-4a4a-b14d-35635e1adc4d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.161600] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.161600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.161600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.162087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.162087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.162087] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1014.190528] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.190528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.190528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.190528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.190955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.201864] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1014.657060] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657060] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baefd685-e2f0-4a4a-b14d-35635e1adc4d with status ACTIVE [ 1014.657060] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.658113] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.658113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.658927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.658927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.658927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.658927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.658927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.658927] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baefd685-e2f0-4a4a-b14d-35635e1adc4d is going to be updated. [ 1014.684386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.684473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.684579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.684872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.685084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.685333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baefd685-e2f0-4a4a-b14d-35635e1adc4d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.027332] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1015.027822] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:2 started [ 1015.139561] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1015.139740] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 1015.139850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.140014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.140241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.140423] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.140537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.140599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.140753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.140834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.140951] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.646035] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.147786] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.213011] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1016.213255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.213465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.213733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.213962] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.214129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.214214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.214418] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.214517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.214627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.214736] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.650370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.650634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.650733] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.651141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.651277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.651412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1016.684188] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.684390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.684501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.684790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.685008] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.698838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1016.717551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.717742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.717742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.717931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.718141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.718290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.718378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.718639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.718744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.718936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.719128] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.719267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.719350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.719578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.719665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.719784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.719784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.719931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.720032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.720145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.720208] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.120158] env[65469]: INFO networking_nsxv3.common.synchronization [req-b72dd05a-c273-4dec-837f-5ea7d0f76304 req-67617a98-8851-4c27-b526-7f468ee23ba2 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1017.121550] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1017.122942] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.122942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.126362] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.126362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.126362] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.225031] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 1017.243428] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.243616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.243696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.243861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.243950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.244161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.244267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.244372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.244466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.244538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.244724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.244815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.244877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.245028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.245107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.245311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.245406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.245461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.245602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.245676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.245761] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1017.338119] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.338347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.338455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.338750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.339102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.357465] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1017.630741] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.830768] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e50d2ca3-8f26-41d5-8aa6-97ba9e284129 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1017.832274] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1017.832438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.832641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.133394] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.558958] env[65469]: INFO networking_nsxv3.common.synchronization [req-35355b57-54b9-481b-9dce-02fc7c38e95f req-6602b414-e4d4-4c38-b942-32c66c8ef83f tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1018.559545] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1018.559864] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.560014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.560097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.560289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.561218] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.561218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.561218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.561218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.561218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.561218] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.635847] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.636058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.636168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.636542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.636591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.636661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1018.668123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.669092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.669092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.669092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.669092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.684015] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1018.708380] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1018.708647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.708832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.709169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.709386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.709518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.709590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.709948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.709948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.709948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.710100] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.065369] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.212866] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.213040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.213124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.213387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.213572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.213671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.213753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.213921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.214037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.214140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.214289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.214380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.214951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.215150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.215293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.215388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.215442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.215880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.215880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.215880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.215880] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.372856] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1019.373138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.568330] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.722484] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 1019.750660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.750848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.750898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.751253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.751404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.751683] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.751794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.751860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.752830] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.752830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.753645] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.753645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.753645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.753645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.753645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.753645] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1019.829805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.830068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.830157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.831276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.832020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.872115] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1020.071568] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.071804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.071804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.072227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.072356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.072500] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1020.102956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.103200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.103245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.103548] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.103696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.114046] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1020.701379] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.701379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.701379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.701379] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.195788] env[65469]: INFO networking_nsxv3.common.synchronization [req-26ff472f-4bd4-4686-a4d7-28d083ccfee4 req-eedd6c1e-bc99-4748-8c46-9cba643ae602 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 1021.196411] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 with Priority: HIGHEST for action security_group_members [ 1021.198876] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.198876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.198876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.198876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.199209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.199209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.199350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.199437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.199518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.199614] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4f7ec7-5508-45fa-9dca-52ca3bb66953',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.204029] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.204161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.204231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.204426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.204501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.204689] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.204779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.204841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.204998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.205300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.205300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1021.237417] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.237595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.237679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.238100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.238314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.272864] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1021.703393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.703771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.703835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.704175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.704327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.705035] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.705035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.705182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.705346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.705496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.705608] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 is going to be updated. [ 1021.741888] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.742040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.742040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.742877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.742877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.751206] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: IN_PROGRESS for 2s [ 1021.880029] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-60deadd6-f734-47aa-bcb4-42b354e24941 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1021.880029] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1021.880029] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.880029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.880029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.880029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.880029] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.880564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.880737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.881097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.881389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.881712] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.885201] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1021.885410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.132052] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1022.132052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.383954] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.385346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.385889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.386189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.386293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.386532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.386648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.386711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.386868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.386977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.387038] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1022.448198] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.448198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.448198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.448198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.448198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.463151] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1022.775653] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.776039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.776039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.776264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.776534] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.776710] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.776983] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.777272] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.777432] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.777649] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.777769] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.777881] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.777994] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.778124] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.778235] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.778442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.814996] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.815312] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.815458] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.815649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.816093] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-93f7aff7-b286-47f6-917f-e539a0ce981c taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.816261] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.816392] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.816825] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.816995] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f7aff7-b286-47f6-917f-e539a0ce981c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.287048] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1023.287596] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 deletion is rescheduled due to dependency. [ 1023.287596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.320503] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.320827] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.321050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.321346] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.321511] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.321689] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 93f7aff7-b286-47f6-917f-e539a0ce981c not found, creating... [ 1023.321988] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.322163] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.322281] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.322853] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.322853] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.322996] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.323133] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.323269] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.323483] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.323613] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.323767] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 93f7aff7-b286-47f6-917f-e539a0ce981c is going to be created. [ 1023.356390] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.356580] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.356707] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.357044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.357261] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.357514] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.762063] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 in Status: SUCCESS [ 1023.762296] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4f7ec7-5508-45fa-9dca-52ca3bb66953 deletion is rescheduled due to dependency. [ 1023.762440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4f7ec7-5508-45fa-9dca-52ca3bb66953" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.050611] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-f89ea1a0-faa3-4294-a6f5-0e000e145f82 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 1024.050611] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-f89ea1a0-faa3-4294-a6f5-0e000e145f82 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1024.050611] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-f89ea1a0-faa3-4294-a6f5-0e000e145f82 service nova] Enqueued Resource ID: 93f7aff7-b286-47f6-917f-e539a0ce981c with Priority: HIGHEST for action port [ 1024.050611] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 1024.051049] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1024.051049] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7aff7-b286-47f6-917f-e539a0ce981c with Priority: HIGHEST for action port [ 1024.051773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.051773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.051773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.052000] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.052153] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.055461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.055461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.055461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-93f7aff7-b286-47f6-917f-e539a0ce981c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.055461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.055461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.055461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.055461] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f7aff7-b286-47f6-917f-e539a0ce981c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.475068] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1024.475068] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 deletion is rescheduled due to dependency. [ 1024.475068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.475211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.475407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.475606] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.475721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.475784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.475944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.476726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.476726] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.497918] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-70c2e488-985c-4396-a9c6-d90e6e759798 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1024.498494] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1024.499241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.499347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.558755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.558755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.558755] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93f7aff7-b286-47f6-917f-e539a0ce981c with status ACTIVE [ 1024.558755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.558755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.559071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.559071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.559150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.559319] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.559449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.559515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.559696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.559829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.560042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.560135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.560188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.560294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.560385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.560473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93f7aff7-b286-47f6-917f-e539a0ce981c is going to be updated. [ 1024.581570] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.581743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.581791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.581971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.582116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.582312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93f7aff7-b286-47f6-917f-e539a0ce981c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.802928] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.803148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.803278] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.803546] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.803805] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.803963] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.804322] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.804578] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.804731] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.805057] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.805057] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.805171] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.805320] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.805454] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.805498] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.805605] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.830859] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.831059] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.831202] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.831383] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-787" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.831692] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-e64d5a41-a355-4588-b896-0b1f20ad8734 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.831860] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.831982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.832419] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.832560] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64d5a41-a355-4588-b896-0b1f20ad8734',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.979060] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.335618] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.336128] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.336128] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.336423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.336607] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.336784] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port e64d5a41-a355-4588-b896-0b1f20ad8734 not found, creating... [ 1025.337137] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.337356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.337514] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.337770] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.337928] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.338278] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.338480] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.338610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.338907] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.339085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.339257] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: e64d5a41-a355-4588-b896-0b1f20ad8734 is going to be created. [ 1025.363115] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.363340] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.363492] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.363836] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.364192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.364456] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.481146] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.984099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.984267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.984336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.984603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.984705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.984807] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1026.019378] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.019569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.019644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.019901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.021345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.034733] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-09696424-0d92-4aa0-8cdb-ed2b04e1ae37 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-09696424-0d92-4aa0-8cdb-ed2b04e1ae37 service nova] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [req-0d183f4a-1a17-4a73-9198-ecb3be2afe50 req-09696424-0d92-4aa0-8cdb-ed2b04e1ae37 service nova] Enqueued Resource ID: e64d5a41-a355-4588-b896-0b1f20ad8734 with Priority: HIGHEST for action port [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_rules [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1026.062402] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64d5a41-a355-4588-b896-0b1f20ad8734 with Priority: HIGHEST for action port [ 1026.062744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.062744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.062926] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.063016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.066627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64d5a41-a355-4588-b896-0b1f20ad8734 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.066627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.066627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.066627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.066802] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64d5a41-a355-4588-b896-0b1f20ad8734',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.569212] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64d5a41-a355-4588-b896-0b1f20ad8734 with status ACTIVE [ 1026.569532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.569605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.569661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.569986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.570099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.570239] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.570347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.570432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.570587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.570664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.570867] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.570963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.571066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.571227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.571306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.571393] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64d5a41-a355-4588-b896-0b1f20ad8734 is going to be updated. [ 1026.595358] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.595513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.595562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.595806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.595938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.596133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64d5a41-a355-4588-b896-0b1f20ad8734" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.676184] env[65469]: INFO networking_nsxv3.common.synchronization [req-aea2a10d-919b-488f-9dc6-0472bf2853c8 req-7bb67706-0251-4c77-a7c8-a1857e4a07dd tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 1026.676771] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGHEST for action security_group_members [ 1026.677107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.677235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.677301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.677497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.677651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.677739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.677797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.677934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.678025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.678117] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.024505] env[65469]: INFO networking_nsxv3.common.synchronization [req-57ab8f06-49ca-4461-96cf-8f68e49dfa10 req-7e97d885-31c6-48b3-9c92-1f2b3eb84c7f tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1027.024505] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1027.024901] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.025061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.025137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.025354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.025532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.025626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.025690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.025841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.025928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.026033] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.181222] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.181404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.181477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.181702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.181796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.181989] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.182126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.182196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.182358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.182434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.182523] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 is going to be updated. [ 1027.220163] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.220163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.220163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.220163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.220163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.231518] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: IN_PROGRESS for 2s [ 1027.529117] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.529117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.529387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.529427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.529849] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.529849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.530089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.530089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.530177] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1027.562042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.562218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.562290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.563111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.563685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.574338] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1028.048783] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1028.049111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.049438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.049926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.050112] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.050335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.050475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.050780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.050943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.051170] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.553954] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.056851] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.243412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc44b284-72eb-4124-9f75-2904f61a5e37 in Status: SUCCESS [ 1029.243412] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 deletion is rescheduled due to dependency. [ 1029.243412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.266483] env[65469]: INFO networking_nsxv3.common.synchronization [req-e00801f9-06ed-4697-8500-fe643c987a8c req-53eea0b6-777b-4483-a41a-f8fbc89196c3 tempest-ServerRescueNegativeTestJSON-1589537906 tempest-ServerRescueNegativeTestJSON-1589537906-project-member] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 1029.267150] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGHEST for action security_group_members [ 1029.267490] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.267619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.267686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.267896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.268072] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.268177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.268238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.268394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.268480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.268574] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.560335] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.560335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.560335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.560335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.560335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.560335] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1029.584464] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1029.584464] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 1029.584464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.599782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.600695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.600695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.600695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.600695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.612956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1029.771335] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.771335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.771335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.771522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.795894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.796203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.797831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.798762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.798762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.798762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.798762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be updated. [ 1029.828972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.829075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.829075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.829400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.829564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.844261] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: IN_PROGRESS for 2s [ 1030.965146] env[65469]: INFO networking_nsxv3.common.synchronization [req-e4bc5fd9-c355-4c25-b429-426ad1c39a83 req-2de14389-a265-4e8d-91aa-7910ecac501f tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1030.965881] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1030.966069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.966271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.966491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.966619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.966750] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.966845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.966902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.967065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.967152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.967248] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.304468] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.304746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.304893] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.305637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.305930] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.306130] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.306270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.306512] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.306676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.306896] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.307031] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.307149] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.307268] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.307378] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.307485] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.307629] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.333689] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.333902] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.334022] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.334210] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.334535] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-9fae0320-98dd-4252-872a-a4138955ef5c taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.334709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.334839] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.335183] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.335329] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fae0320-98dd-4252-872a-a4138955ef5c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.469779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.470013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.470013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.470266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.470405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.470620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.470729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.470819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.470988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.471107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.471199] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 already deleted. [ 1031.471282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.637658] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1031.638054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.638151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.638333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.638520] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.638660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.638742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.638963] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.639031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.639081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.639192] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.640056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.640262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.640458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.640570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.640635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.640778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.640854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.640939] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.837863] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.838129] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.838239] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.838593] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.838753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.838913] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 9fae0320-98dd-4252-872a-a4138955ef5c not found, creating... [ 1031.839270] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.839412] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.839535] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.839766] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.839906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.840208] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.840365] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.840482] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.840690] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.840823] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.840964] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 9fae0320-98dd-4252-872a-a4138955ef5c is going to be created. [ 1031.855587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 in Status: SUCCESS [ 1031.855788] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 deletion is rescheduled due to dependency. [ 1031.855876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.874545] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.874817] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.874953] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.875279] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.875642] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.875836] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.142951] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.143456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.149023] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.604429] env[65469]: INFO networking_nsxv3.common.synchronization [req-e4bc5fd9-c355-4c25-b429-426ad1c39a83 req-b25a0d52-5a10-4c45-bfb4-30cfc647534c service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1032.605168] env[65469]: INFO networking_nsxv3.common.synchronization [req-e4bc5fd9-c355-4c25-b429-426ad1c39a83 req-b25a0d52-5a10-4c45-bfb4-30cfc647534c service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1032.605168] env[65469]: INFO networking_nsxv3.common.synchronization [req-e4bc5fd9-c355-4c25-b429-426ad1c39a83 req-b25a0d52-5a10-4c45-bfb4-30cfc647534c service nova] Enqueued Resource ID: 9fae0320-98dd-4252-872a-a4138955ef5c with Priority: HIGHEST for action port [ 1032.605720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1032.605720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1032.605720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae0320-98dd-4252-872a-a4138955ef5c with Priority: HIGHEST for action port [ 1032.605964] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.607109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.607186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.607503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.607588] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.612690] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.613659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.613659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.613947] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.613947] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.614784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fae0320-98dd-4252-872a-a4138955ef5c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.614918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.614981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.615818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.615818] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fae0320-98dd-4252-872a-a4138955ef5c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.649232] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.650161] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8aa6484b-2820-4773-a63d-2295f7e2d138 None None] Enqueued Resource ID: 82a0554e-8b23-4eb4-a22a-708aa61955be with Priority: HIGHEST for action port [ 1032.650861] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a0554e-8b23-4eb4-a22a-708aa61955be with Priority: HIGHEST for action port [ 1032.651511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a0554e-8b23-4eb4-a22a-708aa61955be taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.651511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a0554e-8b23-4eb4-a22a-708aa61955be" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.651511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a0554e-8b23-4eb4-a22a-708aa61955be" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.651734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a0554e-8b23-4eb4-a22a-708aa61955be" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.651818] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a0554e-8b23-4eb4-a22a-708aa61955be',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.117552] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.117801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.118524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.119559] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fae0320-98dd-4252-872a-a4138955ef5c with status ACTIVE [ 1033.119851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.120051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.120600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.120834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.120915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.121321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.121869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.121978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.122323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.122506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.125200] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.125200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.125200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.125200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.125200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.125200] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fae0320-98dd-4252-872a-a4138955ef5c is going to be updated. [ 1033.151981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.152466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.152466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.152466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.152573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.152691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fae0320-98dd-4252-872a-a4138955ef5c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.153196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.153403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.153465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.153627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.153762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.153875] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1033.155768] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82a0554e-8b23-4eb4-a22a-708aa61955be [ 1033.155961] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.156087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.156143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.156590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.156590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.156590] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82a0554e-8b23-4eb4-a22a-708aa61955be already deleted. [ 1033.156590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a0554e-8b23-4eb4-a22a-708aa61955be" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.185984] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.186154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.186217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.186433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.187585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.198056] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1033.626373] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.131233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.132646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.132646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.132646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.132646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.132646] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be created. [ 1034.166441] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.166932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.166932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.166932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.167118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.182750] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: UNINITIALIZED for 2s [ 1035.209921] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1035.210238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.210647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.210647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.210792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.211155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.211155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.211274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.211307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.211419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.211613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.211690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.211728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.211847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.211979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.212256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.212324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.212718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.212718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.212718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.212718] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.372380] env[65469]: INFO networking_nsxv3.common.synchronization [None req-786b2b3d-ce5e-42f1-a73b-62b210a81d63 None None] Enqueued Resource ID: 6e8cd80b-ab0c-494c-b427-b2511a3d701b with Priority: HIGHEST for action port [ 1035.373770] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8cd80b-ab0c-494c-b427-b2511a3d701b with Priority: HIGHEST for action port [ 1035.374242] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e8cd80b-ab0c-494c-b427-b2511a3d701b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.374408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e8cd80b-ab0c-494c-b427-b2511a3d701b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.374481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e8cd80b-ab0c-494c-b427-b2511a3d701b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.374995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e8cd80b-ab0c-494c-b427-b2511a3d701b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.374995] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e8cd80b-ab0c-494c-b427-b2511a3d701b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.613767] env[65469]: INFO networking_nsxv3.common.synchronization [req-c6106469-9415-45de-9726-b9e0709d1d6a req-daae8294-12b9-486f-83a1-672c851a03d3 tempest-ServersAdminTestJSON-971822007 tempest-ServersAdminTestJSON-971822007-project-member] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 1035.613767] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGHEST for action security_group_members [ 1035.615240] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.615240] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.615240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.615240] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.715772] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f107522e-6192-4b58-8a9d-bdf6cd660823: rpc.has_security_group_logging(os_id): False [ 1035.735435] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.735585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.735699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.735877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.735966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.736165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.736263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.736318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.736465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.736538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.736731] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.736817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.736896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.737201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.737201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.737295] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.737435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.737435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.737760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.737942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.738153] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1035.818762] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.819031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.819111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.819337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.819496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.865972] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1035.878122] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e8cd80b-ab0c-494c-b427-b2511a3d701b [ 1035.878373] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.878509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.878576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.878789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.878879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.879164] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e8cd80b-ab0c-494c-b427-b2511a3d701b already deleted. [ 1035.879284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e8cd80b-ab0c-494c-b427-b2511a3d701b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.117560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.117751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.117795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.120057] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.120057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.120057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be updated. [ 1036.150493] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.150662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.151190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.151190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.151190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.160915] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: IN_PROGRESS for 2s [ 1036.200155] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1036.200410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.200584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.200805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.200995] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.201220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.201393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.201454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.201612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.201612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.201720] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.706579] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.706887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.706887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.706957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.707137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.707224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.707287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.707429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.707511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.707593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.707733] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.707821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.707877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.708035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.708245] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.708325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.708325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.708451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.709092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.709092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.709092] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.885528] env[65469]: INFO networking_nsxv3.common.synchronization [req-c29505ca-49b4-430e-8bfe-7c19ccc2a7e1 req-d8b5cde8-0375-4dcd-a148-b59544c94915 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1036.887028] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1036.887692] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.887692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.887692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.888157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.888348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.888515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.888595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.888762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.889046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.889046] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.213023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd6b3522-babc-4977-91f4-6a81f2f59e88: rpc.has_security_group_logging(os_id): False [ 1037.233448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.233448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233994] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.233994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.233994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.234109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.235188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.235188] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be created. [ 1037.299770] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.299969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.299969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.300214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.300459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.312733] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1037.385761] env[65469]: INFO networking_nsxv3.common.synchronization [req-6ee8fb12-42c8-4b17-92b9-a2994ab99d49 req-f3632349-1219-4d58-9d26-6d227e2eaf17 tempest-MultipleCreateTestJSON-1177909801 tempest-MultipleCreateTestJSON-1177909801-project-member] Enqueued Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1037.386340] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f107522e-6192-4b58-8a9d-bdf6cd660823 with Priority: HIGHEST for action security_group_members [ 1037.386662] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-f107522e-6192-4b58-8a9d-bdf6cd660823 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.386768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.391497] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.897800] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.910533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1037.910761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.910922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.911278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.911379] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.173530] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a in Status: SUCCESS [ 1038.173733] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a deletion is rescheduled due to dependency. [ 1038.174122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.400325] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.400325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.400620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.400723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.400836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.401391] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be updated. [ 1038.436244] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.436244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.436244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.436438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.436438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.436515] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be deleted. [ 1038.438422] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.438422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.438692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.438692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.438812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.456024] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: IN_PROGRESS for 2s [ 1038.612594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.612594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.612594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.612594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.612594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.612594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.328979] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1039.329310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.464136] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f107522e-6192-4b58-8a9d-bdf6cd660823 in Status: SUCCESS [ 1040.464136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.464479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.464523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.464694] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.464844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.464887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.465032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.465112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.465207] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f107522e-6192-4b58-8a9d-bdf6cd660823',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.714475] env[65469]: INFO networking_nsxv3.common.synchronization [req-3afea8e7-0f74-4b35-81ff-7e01808ef9dc req-1ae82287-c162-4452-9d2f-3eff502fa7b7 tempest-ServersAdminNegativeTestJSON-1911609592 tempest-ServersAdminNegativeTestJSON-1911609592-project-member] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1040.716851] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1040.716851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.716851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.716851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.716851] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.968015] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.968281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.968281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.968487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.968579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.968779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.968877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.968939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.969139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.969280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.969318] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f107522e-6192-4b58-8a9d-bdf6cd660823 is going to be deleted. [ 1041.005581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.005581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.005581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.005581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.005925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.005925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f107522e-6192-4b58-8a9d-bdf6cd660823" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.128068] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.128323] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.128470] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.128776] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.128999] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.129183] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.129304] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.129528] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.129671] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.129874] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.129986] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.130105] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.130212] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.130323] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.130457] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.130604] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.150938] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.151236] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.151422] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.151590] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-407" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.151906] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.152228] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.152326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.152637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.152795] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cd4d626-f2b9-4450-b7c0-78cc74c98bd0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.222063] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.473857] env[65469]: INFO networking_nsxv3.common.synchronization [None req-1e4dd894-36f5-4a99-9b05-9cdc376e8d08 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1041.474421] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1041.474731] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.474855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.474923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.475197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.475286] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.655023] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.655285] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.655551] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.655808] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.655966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.656138] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 not found, creating... [ 1041.656408] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.656567] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.657153] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.657153] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.657153] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.657429] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.657549] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.657638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.657848] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.657985] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.658140] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 is going to be created. [ 1041.685310] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.685607] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.685796] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.686223] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.686548] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.686886] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.722737] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.762140] env[65469]: INFO networking_nsxv3.common.synchronization [None req-b212859d-e244-4ece-aae9-06d718dd1169 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1041.762727] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1041.763246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.763373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.995577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.995801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.995885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.996333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996436] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 already deleted. [ 1041.996557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996752] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.997034] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.226237] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.226506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.226632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.226905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.227048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.227178] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1042.261657] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.261657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.261657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.261657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.261657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.273096] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1042.514080] env[65469]: INFO networking_nsxv3.common.synchronization [req-3afea8e7-0f74-4b35-81ff-7e01808ef9dc req-2faf5284-c847-48ee-818b-d7460ff84ef7 service nova] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_rules [ 1042.514376] env[65469]: INFO networking_nsxv3.common.synchronization [req-3afea8e7-0f74-4b35-81ff-7e01808ef9dc req-2faf5284-c847-48ee-818b-d7460ff84ef7 service nova] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1042.514455] env[65469]: INFO networking_nsxv3.common.synchronization [req-3afea8e7-0f74-4b35-81ff-7e01808ef9dc req-2faf5284-c847-48ee-818b-d7460ff84ef7 service nova] Enqueued Resource ID: 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 with Priority: HIGHEST for action port [ 1042.514911] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_rules [ 1042.515626] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1042.515626] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 with Priority: HIGHEST for action port [ 1042.515758] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.515871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.515979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.516149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.516268] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.517543] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.517636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.517884] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.517985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.517985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.518154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.518306] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cd4d626-f2b9-4450-b7c0-78cc74c98bd0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.520998] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.521125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.521278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.521465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.521553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.521667] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 already deleted. [ 1042.521771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.021468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.021468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.024351] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 with status ACTIVE [ 1043.024351] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.024351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.024351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.024678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.024731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.024933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.025386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.025386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.025386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.025386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.025689] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.025689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.025779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.025991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.026087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.026128] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cd4d626-f2b9-4450-b7c0-78cc74c98bd0 is going to be updated. [ 1043.056996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.057182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.057245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.057522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.057672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.057955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cd4d626-f2b9-4450-b7c0-78cc74c98bd0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.286708] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1044.287103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.287309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.287616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.288111] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.288299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.288408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.288664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.288792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.288943] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.791998] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.294952] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.799118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.799118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.799118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.799118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.799118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.799718] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1045.844453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.844453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.844453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.844453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.844867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.859041] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1045.878598] env[65469]: INFO networking_nsxv3.common.synchronization [req-abcb008f-f230-423f-95d9-60a263e07454 req-00d16774-9f00-4790-b97e-838792f40255 tempest-ServerAddressesNegativeTestJSON-588148369 tempest-ServerAddressesNegativeTestJSON-588148369-project-member] Enqueued Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1045.879304] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1045.879560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.879689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.880811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.880811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.880811] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.331676] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.331676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-907" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.332023] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-907" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.333911] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-907" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.334236] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.334785] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.334785] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.335438] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.335653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.336046] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.336046] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.336721] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.336900] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.337042] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.337155] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.337327] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.362063] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.362286] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1046.362438] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.362628] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-907" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.362987] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-c85dd918-e8e3-4ca6-8bec-221f3bd40517 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.363195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.363317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.363784] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.363925] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c85dd918-e8e3-4ca6-8bec-221f3bd40517',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.383536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.383770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.383872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.384208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.384320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.384612] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.384785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.384871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.385140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.385281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.385433] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d287eaed-f226-46a7-8661-38075c224166 already deleted. [ 1046.385575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.868123] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.868650] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.869508] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.869508] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.869647] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.869912] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port c85dd918-e8e3-4ca6-8bec-221f3bd40517 not found, creating... [ 1046.871310] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.871711] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.871824] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.872226] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.872467] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.872974] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.873504] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.873504] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.873850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.873850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.874023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: c85dd918-e8e3-4ca6-8bec-221f3bd40517 is going to be created. [ 1046.903419] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.903695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.903866] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.904190] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.904366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.904596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.667976] env[65469]: INFO networking_nsxv3.common.synchronization [req-abcb008f-f230-423f-95d9-60a263e07454 req-ca2b3202-2f37-42af-992d-586646bb975a service nova] Enqueued Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_rules [ 1047.667976] env[65469]: INFO networking_nsxv3.common.synchronization [req-abcb008f-f230-423f-95d9-60a263e07454 req-ca2b3202-2f37-42af-992d-586646bb975a service nova] Enqueued Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1047.667976] env[65469]: INFO networking_nsxv3.common.synchronization [req-abcb008f-f230-423f-95d9-60a263e07454 req-ca2b3202-2f37-42af-992d-586646bb975a service nova] Enqueued Resource ID: c85dd918-e8e3-4ca6-8bec-221f3bd40517 with Priority: HIGHEST for action port [ 1047.670090] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_rules [ 1047.670090] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1047.670090] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85dd918-e8e3-4ca6-8bec-221f3bd40517 with Priority: HIGHEST for action port [ 1047.671035] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.671035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.671035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.672476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.672476] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.673279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.673431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.673501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.673730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.673904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.674036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.674137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.674267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.674371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.674760] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.678367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c85dd918-e8e3-4ca6-8bec-221f3bd40517 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.678438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.678491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.678725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.678725] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c85dd918-e8e3-4ca6-8bec-221f3bd40517',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.870832] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1047.871083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.871359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.871595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.871788] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.871909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.871975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.873361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.873361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.873361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.873887] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.173511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.173715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.178113] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.181783] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c85dd918-e8e3-4ca6-8bec-221f3bd40517 with status ACTIVE [ 1048.181957] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.182098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.182163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.182433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.182527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.182706] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.182812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.182878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.183055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.183134] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.183323] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.183400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.183457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.183594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.183667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.183752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c85dd918-e8e3-4ca6-8bec-221f3bd40517 is going to be updated. [ 1048.208410] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.208410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.208410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.208410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.208410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.208410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c85dd918-e8e3-4ca6-8bec-221f3bd40517" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.379751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.380095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.380095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.380300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.380490] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.380618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.380731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.380951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.381062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.381176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.381390] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.381528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.381604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.381798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.381967] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.382086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.382176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.382373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.382490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.382587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.382682] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.680932] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.889587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ff0417e-ec9b-4d09-9e53-7e07d24399c0: rpc.has_security_group_logging(os_id): False [ 1048.911322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.911736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.911736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.912054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.912144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.913792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.913792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.913792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.914348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.914348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.914548] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.914713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.914829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.915106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.915238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.915378] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1048.993676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.993676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.993676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.994066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.994108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.009882] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1049.184097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.184303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.184411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.184756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.184935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.185078] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d287eaed-f226-46a7-8661-38075c224166 is going to be created. [ 1049.214705] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.215727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.215727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.215727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.215928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.228743] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: UNINITIALIZED for 2s [ 1049.254812] env[65469]: INFO networking_nsxv3.common.synchronization [None req-03f11155-ef01-4913-bc4b-7faaf5bc43e7 None None] Enqueued Resource ID: 4e088909-1ce0-4698-a18f-c303f81b397e with Priority: HIGHEST for action port [ 1049.255849] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e088909-1ce0-4698-a18f-c303f81b397e with Priority: HIGHEST for action port [ 1049.255849] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e088909-1ce0-4698-a18f-c303f81b397e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.255849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e088909-1ce0-4698-a18f-c303f81b397e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.256447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e088909-1ce0-4698-a18f-c303f81b397e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.256447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e088909-1ce0-4698-a18f-c303f81b397e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.256447] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e088909-1ce0-4698-a18f-c303f81b397e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.759086] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e088909-1ce0-4698-a18f-c303f81b397e [ 1049.760244] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.760244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.760244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.760244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.760244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.760244] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e088909-1ce0-4698-a18f-c303f81b397e already deleted. [ 1049.760244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e088909-1ce0-4698-a18f-c303f81b397e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.030856] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1051.030856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.239921] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: SUCCESS [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.242346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.242346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.242346] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.745659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.745659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.745659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.745659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.748728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.748728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.748728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.748728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.748728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.748728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.748728] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.758049] env[65469]: INFO networking_nsxv3.common.synchronization [None req-b48250f3-e24c-4930-a2b6-622c9c923862 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1051.758049] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1051.759702] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ab547e96-38ba-4b06-94de-61bd8602cf2e None None] Enqueued Resource ID: ad9da2ba-0688-4886-88f1-0c0c72ef7d54 with Priority: HIGHEST for action port [ 1051.760082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.761240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.761240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.761240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.761240] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.763236] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9da2ba-0688-4886-88f1-0c0c72ef7d54 with Priority: HIGHEST for action port [ 1051.764579] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad9da2ba-0688-4886-88f1-0c0c72ef7d54 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.764579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad9da2ba-0688-4886-88f1-0c0c72ef7d54" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.766842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad9da2ba-0688-4886-88f1-0c0c72ef7d54" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.766842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad9da2ba-0688-4886-88f1-0c0c72ef7d54" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.766842] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad9da2ba-0688-4886-88f1-0c0c72ef7d54',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.253949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d287eaed-f226-46a7-8661-38075c224166: rpc.has_security_group_logging(os_id): False [ 1052.267935] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad9da2ba-0688-4886-88f1-0c0c72ef7d54 [ 1052.267935] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.267935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.267935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.268227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.268227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.268227] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad9da2ba-0688-4886-88f1-0c0c72ef7d54 already deleted. [ 1052.268227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad9da2ba-0688-4886-88f1-0c0c72ef7d54" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.275013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.275160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.275214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.275432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.275510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.275709] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.275807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.275871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.276030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.276111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.276299] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.276392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.276454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.276595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.276668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.276852] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.276943] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.277236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.277236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.277236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.277358] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d287eaed-f226-46a7-8661-38075c224166 is going to be created. [ 1052.283898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.284133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.284133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.284316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.284403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.284495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 already deleted. [ 1052.284577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.352422] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.352661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.352661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.364907] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: IN_PROGRESS for 2s [ 1052.533291] env[65469]: INFO networking_nsxv3.common.synchronization [None req-1e2c60db-fffb-44fc-9ce2-f62f784df32e tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1052.534427] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1052.534993] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.535141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.535204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.535934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.535934] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.063020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.063020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.063020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.063020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.063020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.063020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 already deleted. [ 1053.063020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.162813] env[65469]: INFO networking_nsxv3.common.synchronization [None req-cd3d69a0-1faa-42c8-b94a-499e01b30677 None None] Enqueued Resource ID: 9d10ddff-8f96-48af-877a-d5a4c1db8eb6 with Priority: HIGHEST for action port [ 1054.164543] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d10ddff-8f96-48af-877a-d5a4c1db8eb6 with Priority: HIGHEST for action port [ 1054.165753] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d10ddff-8f96-48af-877a-d5a4c1db8eb6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.165882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d10ddff-8f96-48af-877a-d5a4c1db8eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.165967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d10ddff-8f96-48af-877a-d5a4c1db8eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.166253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d10ddff-8f96-48af-877a-d5a4c1db8eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.166344] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d10ddff-8f96-48af-877a-d5a4c1db8eb6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.383028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: SUCCESS [ 1054.383028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.541406] env[65469]: INFO networking_nsxv3.common.synchronization [req-7a4ecf70-5ba4-4270-b96e-f3581f4ef3a2 req-b549839d-44e2-4702-9d15-bd9e9ceace4b tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1054.542153] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1054.542450] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.542973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.543060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.543263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.543477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.543570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.543570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.543723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.543809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.543901] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.670659] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d10ddff-8f96-48af-877a-d5a4c1db8eb6 [ 1054.672308] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.672308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.672308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.672308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.672308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.672308] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d10ddff-8f96-48af-877a-d5a4c1db8eb6 already deleted. [ 1054.672308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d10ddff-8f96-48af-877a-d5a4c1db8eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.006507] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.006708] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.006832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.007132] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.007393] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.007566] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.007658] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.007933] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.008078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.008236] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.008348] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.008458] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.008561] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.008667] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.008773] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.008902] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.031523] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.031711] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.031859] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.032062] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.032917] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-b5649385-8c85-46f9-9da6-a246a29e1746 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.033129] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.033255] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.033587] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.033737] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5649385-8c85-46f9-9da6-a246a29e1746',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.045996] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.536321] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.536676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.536676] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.536973] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.537141] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.537294] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port b5649385-8c85-46f9-9da6-a246a29e1746 not found, creating... [ 1055.537558] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.540302] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.540302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.540302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: b5649385-8c85-46f9-9da6-a246a29e1746 is going to be created. [ 1055.552461] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.562268] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.563041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.563041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.563041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.563317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.563541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.056016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.056016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.056016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.056711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.056711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.056711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1056.095613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.095836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.095896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.096195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.096410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.108524] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1056.342509] env[65469]: INFO networking_nsxv3.common.synchronization [req-7a4ecf70-5ba4-4270-b96e-f3581f4ef3a2 req-6731c5d2-f610-426d-befb-2f1ece0d976b service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 1056.342509] env[65469]: INFO networking_nsxv3.common.synchronization [req-7a4ecf70-5ba4-4270-b96e-f3581f4ef3a2 req-6731c5d2-f610-426d-befb-2f1ece0d976b service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1056.342509] env[65469]: INFO networking_nsxv3.common.synchronization [req-7a4ecf70-5ba4-4270-b96e-f3581f4ef3a2 req-6731c5d2-f610-426d-befb-2f1ece0d976b service nova] Enqueued Resource ID: b5649385-8c85-46f9-9da6-a246a29e1746 with Priority: HIGHEST for action port [ 1056.344156] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 1056.344369] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1056.344446] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5649385-8c85-46f9-9da6-a246a29e1746 with Priority: HIGHEST for action port [ 1056.344744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.344879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.344944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.345188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.345276] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.348373] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.348373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.348594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5649385-8c85-46f9-9da6-a246a29e1746 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.348594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.348594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.348981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.348981] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5649385-8c85-46f9-9da6-a246a29e1746',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.755484] env[65469]: INFO networking_nsxv3.common.synchronization [None req-e3a4ff29-d4b5-4929-9397-8a62a50504cb None None] Enqueued Resource ID: 9cf7678f-eb2a-4d0b-a586-078e605e9b32 with Priority: HIGHEST for action port [ 1056.755888] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf7678f-eb2a-4d0b-a586-078e605e9b32 with Priority: HIGHEST for action port [ 1056.755955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cf7678f-eb2a-4d0b-a586-078e605e9b32 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.756141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cf7678f-eb2a-4d0b-a586-078e605e9b32" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.756201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cf7678f-eb2a-4d0b-a586-078e605e9b32" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.756398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cf7678f-eb2a-4d0b-a586-078e605e9b32" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.756703] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cf7678f-eb2a-4d0b-a586-078e605e9b32',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.767138] env[65469]: INFO networking_nsxv3.common.synchronization [req-441ea60f-cbf5-45bb-9785-a8e6624d89ae req-e91d2550-c826-4adb-a4f1-98131e8676cb tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1056.767682] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1056.768014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.769467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.769590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.770828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.770828] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.770828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.770828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.770828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.770828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.770828] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.850388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.850621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.850702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5649385-8c85-46f9-9da6-a246a29e1746 with status ACTIVE [ 1056.851113] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.851113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.851113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.851621] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.851744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.851744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.852120] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.852253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.852253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.852414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.852758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.852758] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5649385-8c85-46f9-9da6-a246a29e1746 is going to be updated. [ 1056.877106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.877305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.877436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.877686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.877862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.878075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5649385-8c85-46f9-9da6-a246a29e1746" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.258408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cf7678f-eb2a-4d0b-a586-078e605e9b32 [ 1057.258651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.258786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.258934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.259086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.259217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.259293] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cf7678f-eb2a-4d0b-a586-078e605e9b32 already deleted. [ 1057.259339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cf7678f-eb2a-4d0b-a586-078e605e9b32" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.273112] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.273834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.273834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.273834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.274182] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.274256] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.274378] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.274595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.274735] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.274930] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.275141] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.275219] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.275271] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.275362] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.275468] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.275594] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.277398] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.277512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.277576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.277724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.277869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.278010] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.278114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.278174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.278311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.278385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.278465] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 already deleted. [ 1057.278581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.306034] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.306034] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.306278] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.306278] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.306985] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-74e82311-5b32-4db5-9ad3-5fc105d0430e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.306985] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.306985] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.307252] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.309107] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74e82311-5b32-4db5-9ad3-5fc105d0430e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.810055] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.810055] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.810565] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.810565] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.811192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.811255] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 74e82311-5b32-4db5-9ad3-5fc105d0430e not found, creating... [ 1057.811606] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.811772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.811892] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.812211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.812289] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.812622] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.812786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.812905] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.813137] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.813271] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.813410] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 74e82311-5b32-4db5-9ad3-5fc105d0430e is going to be created. [ 1057.841022] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.841294] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.841457] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.841746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.841973] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.842251] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.973061] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.973320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.973320] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.973968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.973968] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.067116] env[65469]: INFO networking_nsxv3.common.synchronization [None req-cf0ad2f2-c537-4ae3-8249-c768368276d6 None None] Enqueued Resource ID: 93723e3e-a385-46ef-b684-8b39a0555cb0 with Priority: HIGHEST for action port [ 1058.067116] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93723e3e-a385-46ef-b684-8b39a0555cb0 with Priority: HIGHEST for action port [ 1058.067116] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-93723e3e-a385-46ef-b684-8b39a0555cb0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.067116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93723e3e-a385-46ef-b684-8b39a0555cb0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.067116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93723e3e-a385-46ef-b684-8b39a0555cb0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.067912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93723e3e-a385-46ef-b684-8b39a0555cb0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.068128] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93723e3e-a385-46ef-b684-8b39a0555cb0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.125723] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1058.125977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.126219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.126435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.126630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.126740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.126832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.126994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.127087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.127195] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.475926] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.572834] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93723e3e-a385-46ef-b684-8b39a0555cb0 [ 1058.573081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.573226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.573293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.574239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.574239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.574239] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93723e3e-a385-46ef-b684-8b39a0555cb0 already deleted. [ 1058.574239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93723e3e-a385-46ef-b684-8b39a0555cb0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.635150] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.644831] env[65469]: INFO networking_nsxv3.common.synchronization [req-441ea60f-cbf5-45bb-9785-a8e6624d89ae req-3c82038d-186f-415a-bf58-e255dbd74a7b service nova] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1058.645043] env[65469]: INFO networking_nsxv3.common.synchronization [req-441ea60f-cbf5-45bb-9785-a8e6624d89ae req-3c82038d-186f-415a-bf58-e255dbd74a7b service nova] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1058.645188] env[65469]: INFO networking_nsxv3.common.synchronization [req-441ea60f-cbf5-45bb-9785-a8e6624d89ae req-3c82038d-186f-415a-bf58-e255dbd74a7b service nova] Enqueued Resource ID: 74e82311-5b32-4db5-9ad3-5fc105d0430e with Priority: HIGHEST for action port [ 1058.645760] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1058.645980] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1058.646034] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74e82311-5b32-4db5-9ad3-5fc105d0430e with Priority: HIGHEST for action port [ 1058.646356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.646528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.646590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.646765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.646847] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.647728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.647854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.647914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.648911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.652086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.652086] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.652086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-74e82311-5b32-4db5-9ad3-5fc105d0430e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.652086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.652086] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74e82311-5b32-4db5-9ad3-5fc105d0430e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.873760] env[65469]: INFO networking_nsxv3.common.synchronization [req-0c058c1e-9380-4c6d-9ef2-4fdb3dad8560 req-8e677bee-f010-45bc-af5e-439a8cfcbace tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1058.874088] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1058.874221] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.874342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.874385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.875438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.875438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.875438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.875438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.875438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.875438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.875438] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.980827] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.139934] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.155302] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.155506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.155638] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.156742] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74e82311-5b32-4db5-9ad3-5fc105d0430e with status ACTIVE [ 1059.156940] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.157340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.157340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.157340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.157552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.157617] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.157688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.157754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.157893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.157980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.158211] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.158299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.158355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.158599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.158599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.158702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74e82311-5b32-4db5-9ad3-5fc105d0430e is going to be updated. [ 1059.186523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.186523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.186641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.186849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.187018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.187536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74e82311-5b32-4db5-9ad3-5fc105d0430e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.375024] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.375024] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.375024] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.375024] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.375024] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.375024] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.375024] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.376130] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.376130] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.376130] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.382233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.382475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.382475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.382700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.382784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.382974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.383100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.383153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.383319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.383384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.383429] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1059.398027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.398210] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.398349] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.399032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-648" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.399032] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-73addc35-a3f4-4aa4-993d-a92670c5e9af taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.399032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.399259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.399477] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.399605] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73addc35-a3f4-4aa4-993d-a92670c5e9af',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.423045] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.423045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.423045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.423351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.423402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.436023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1059.482999] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1059.483150] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1059.643540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.643830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.643830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.644251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.644251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.644423] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1059.662519] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.693266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.693266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.693266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.693525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.693772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.706943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1059.902649] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.903243] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.903243] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.903422] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.903498] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.903889] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 73addc35-a3f4-4aa4-993d-a92670c5e9af not found, creating... [ 1059.904305] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.904562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.904738] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.905159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.905319] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.905738] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.906446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.906446] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.906657] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.906890] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.907295] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 73addc35-a3f4-4aa4-993d-a92670c5e9af is going to be created. [ 1059.931917] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.932173] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.932320] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.932674] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.932921] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.933232] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.167461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.167659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.167728] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.167964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.168122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.168189] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be created. [ 1060.204099] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.204256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.204319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.204677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.204846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.218799] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: UNINITIALIZED for 2s [ 1060.426934] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a79bf146-5d97-4f67-aa40-4ed24b264ddc None None] Enqueued Resource ID: c8672eac-1a60-4599-9b3b-66b3a81d6294 with Priority: HIGHEST for action port [ 1060.427684] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8672eac-1a60-4599-9b3b-66b3a81d6294 with Priority: HIGHEST for action port [ 1060.428971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8672eac-1a60-4599-9b3b-66b3a81d6294 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.429125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8672eac-1a60-4599-9b3b-66b3a81d6294" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.429220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8672eac-1a60-4599-9b3b-66b3a81d6294" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.429521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8672eac-1a60-4599-9b3b-66b3a81d6294" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.429612] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8672eac-1a60-4599-9b3b-66b3a81d6294',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [req-0c058c1e-9380-4c6d-9ef2-4fdb3dad8560 req-a102fa1e-09a0-47f0-8795-120e8b0df217 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [req-0c058c1e-9380-4c6d-9ef2-4fdb3dad8560 req-a102fa1e-09a0-47f0-8795-120e8b0df217 service nova] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [req-0c058c1e-9380-4c6d-9ef2-4fdb3dad8560 req-a102fa1e-09a0-47f0-8795-120e8b0df217 service nova] Enqueued Resource ID: 73addc35-a3f4-4aa4-993d-a92670c5e9af with Priority: HIGHEST for action port [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_rules [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1060.714233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73addc35-a3f4-4aa4-993d-a92670c5e9af with Priority: HIGHEST for action port [ 1060.714233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.714233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.714233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.715694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.716014] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.717909] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.718252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.718841] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-73addc35-a3f4-4aa4-993d-a92670c5e9af taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.718841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.718841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.720235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.720521] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73addc35-a3f4-4aa4-993d-a92670c5e9af',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.722572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.722713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.722832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.723156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.737277] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1060.739618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.740642] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1060.811807] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.812022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.812120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.812258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.827030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.827030] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1060.827030] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.827030] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1060.895446] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.895613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.895677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.895920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.897451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.897657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1060.935565] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8672eac-1a60-4599-9b3b-66b3a81d6294 [ 1060.935565] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.935565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.935565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.935565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.935565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.935565] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8672eac-1a60-4599-9b3b-66b3a81d6294 already deleted. [ 1060.935565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8672eac-1a60-4599-9b3b-66b3a81d6294" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.991660] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.991779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.991779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.991971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.992287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.992734] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1061.115838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.116281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.116414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.116697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.117583] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.118052] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1061.118423] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc44b284-72eb-4124-9f75-2904f61a5e37', '1934be84-8ae3-4bd7-9b51-c38b417cac45', '7ff0417e-ec9b-4d09-9e53-7e07d24399c0', 'ee1b710f-8b96-44eb-b935-7e6dcdbe6f18', 'a78cf656-0352-46dc-9e26-9fd8a6ca6ce0', 'c6f27ff1-776e-4a70-90a6-ebc268939e44', '5be86bbb-df18-464c-9cd6-f07241444961', '8608a4da-285d-4dc3-aa08-db64404925d5', 'c9754e57-d686-47f2-9c6f-de699c5ba485', 'bff04faf-b1e3-4f4f-be69-a0b7e048e966', '885e7f1b-e47b-4285-ab7d-029f48a54f6a', '709a1070-5186-40a8-ad7e-f0a18412647f', '4b4d51f5-922c-4c9c-8040-9d222ed7cbcb', '8710ede3-753e-4d9b-b6ab-3276d28c0b69', '2d29c1b7-7d3c-4651-9e62-14cee71b96b1', 'd0450b87-9656-4a30-b7b0-3f5285ac5d52', '80280ff5-2173-4569-9e09-d7fdc89693a7', '3cc2d080-06d1-43db-887c-b69e9dc7db6e', '4e6975d0-2064-42d1-b410-13058e6b3c61', '49239a3f-71c3-4a6e-a70e-4e35fc82c66d', 'e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d', 'd287eaed-f226-46a7-8661-38075c224166', '2456e406-10ff-453e-9e7e-01913e34d9c7', '4678c753-8db4-4c5c-893f-3e320ded5c02', '93250c38-ef03-4516-b959-0aa8baeef74a', 'b309be15-6460-49da-bd48-e95c49f1421b', 'fb6e69ce-aa18-43cb-be60-af4e37502a7a', '5bde506b-06fa-4939-b031-63dc38218dcc', '92bf433d-c39b-4344-960c-b8e0607c3036', '8c49bdcf-f8e3-4883-b509-795a54e2f950', '0e0e254f-6737-4701-b8b1-b6906deeb63f', '641bf348-fb8f-499f-a944-4cb315e55733', '5faeab0c-fd4f-463f-b917-048fa4f0ebd1', 'f1fe9c7b-391a-4964-94bd-fd69c7fb232c', '7663bbf6-b391-494e-9a60-db9d723b0635', 'ab3db8e0-1f52-4d95-9b58-4be9adf31de9', '3ad20fef-905e-4efe-bdf9-75c98decc63b', '5863af48-2574-424a-a51b-dcfeb0d1a63d', '470f3367-e1b6-4e76-8701-774a6b0e92ae', '2f4f7ec7-5508-45fa-9dca-52ca3bb66953', '2d3a53e0-bc08-4699-b179-a2a446524a23', '1222eeb9-9dbe-496c-9f03-31010145cde2', 'aa96ab4a-8a16-4875-8013-1f1b9504c258', 'fd6b3522-babc-4977-91f4-6a81f2f59e88', '1f756a88-e1c6-407c-9a54-9002d0c269ee', 'b72348dc-32e6-4663-85f1-f411e222a7a4'} {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.118589] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1061.144217] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.144400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.144499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.144901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.144901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.145074] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1061.145177] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.145281] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1061.194044] env[65469]: INFO networking_nsxv3.common.synchronization [req-5d8b229a-324e-4aa9-a237-c9cfa5340ff4 req-c0283664-18be-42a4-bde3-c22bdd564002 tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1061.194939] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1061.195429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.195566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.195634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.195845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.196343] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.196491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.196561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.196741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.196832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.196964] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.243064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.243313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.243533] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73addc35-a3f4-4aa4-993d-a92670c5e9af with status ACTIVE [ 1061.243765] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.243925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.244044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.244388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.244491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.244701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.244844] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.244944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.245169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.245281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.245536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.245670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.245768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.245972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.246103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.246226] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73addc35-a3f4-4aa4-993d-a92670c5e9af is going to be updated. [ 1061.249586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.249799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.249885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.250147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.251344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.251645] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1061.251729] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.251800] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1061.251863] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1061.251943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1061.252166] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGH for action security_group_rules [ 1061.252296] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGH for action security_group_rules [ 1061.252421] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGH for action security_group_rules [ 1061.252548] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGH for action security_group_rules [ 1061.252664] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGH for action security_group_rules [ 1061.252768] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGH for action security_group_rules [ 1061.252862] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGH for action security_group_rules [ 1061.252952] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1061.253118] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGH for action security_group_rules [ 1061.253118] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGH for action security_group_rules [ 1061.253215] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGH for action security_group_rules [ 1061.253300] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 1061.253641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGH for action security_group_rules [ 1061.253641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGH for action security_group_rules [ 1061.253641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGH for action security_group_rules [ 1061.253641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 1061.253641] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGH for action security_group_rules [ 1061.253875] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGH for action security_group_rules [ 1061.253930] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 1061.254084] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGH for action security_group_rules [ 1061.254233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.289121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.289390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.289467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.289817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.290113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.290240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73addc35-a3f4-4aa4-993d-a92670c5e9af" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.454516] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1061.454706] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 1061.454706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.454849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.455190] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.455311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.455473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.455521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.455653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.455721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.455823] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.491380] env[65469]: INFO networking_nsxv3.common.synchronization [req-e73b11c9-fd62-4e46-b138-c59355d7fbcf req-5a873379-9c8b-4579-b2a3-9f0b0f31f1dc tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1061.492042] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1061.492227] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc44b284-72eb-4124-9f75-2904f61a5e37 with Priority: HIGH for action security_group_rules [ 1061.492353] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGH for action security_group_rules [ 1061.492466] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGH for action security_group_rules [ 1061.492564] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 with Priority: HIGH for action security_group_rules [ 1061.492666] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d with Priority: HIGH for action security_group_rules [ 1061.492757] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 1061.492846] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e with Priority: HIGH for action security_group_rules [ 1061.492936] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 with Priority: HIGH for action security_group_rules [ 1061.493039] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 with Priority: HIGH for action security_group_rules [ 1061.493133] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 1061.493223] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb with Priority: HIGH for action security_group_rules [ 1061.493305] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 1061.493393] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGH for action security_group_rules [ 1061.493481] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 with Priority: HIGH for action security_group_rules [ 1061.493567] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9754e57-d686-47f2-9c6f-de699c5ba485 with Priority: HIGH for action security_group_rules [ 1061.493695] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGH for action security_group_rules [ 1061.493781] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1061.493896] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 with Priority: HIGH for action security_group_rules [ 1061.493986] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 with Priority: HIGH for action security_group_rules [ 1061.494196] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 with Priority: HIGH for action security_group_rules [ 1061.494829] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.494829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.494829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.495221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.495221] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.495221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.495221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.495884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.495884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.495884] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.496750] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc44b284-72eb-4124-9f75-2904f61a5e37 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.496750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.496750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.497063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.497063] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc44b284-72eb-4124-9f75-2904f61a5e37',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.498171] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.498303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.498357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.499031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.499031] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.499476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.502315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.502422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.502630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.502711] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.505288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.505288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.505288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.505288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.505288] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d29c1b7-7d3c-4651-9e62-14cee71b96b1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.505288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.505634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.505634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.505634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.505634] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49239a3f-71c3-4a6e-a70e-4e35fc82c66d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.508874] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.508874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.508874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.508874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.509370] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.509763] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.511479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.511479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.511479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.511479] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc2d080-06d1-43db-887c-b69e9dc7db6e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.511966] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80280ff5-2173-4569-9e09-d7fdc89693a7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.512294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.512294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.513258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.513258] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80280ff5-2173-4569-9e09-d7fdc89693a7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.515724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.515724] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8710ede3-753e-4d9b-b6ab-3276d28c0b69',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.515724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.515724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.515724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.515724] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4d51f5-922c-4c9c-8040-9d222ed7cbcb',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.516436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.516436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.516566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.516626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.516680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.516789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.516852] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.517751] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.517859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.517925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.518115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.518189] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff04faf-b1e3-4f4f-be69-a0b7e048e966',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.518908] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9754e57-d686-47f2-9c6f-de699c5ba485 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.519022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.519086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.519292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.519292] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9754e57-d686-47f2-9c6f-de699c5ba485',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.520014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.520121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.520180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.520326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.520398] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.521347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.521347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.521760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.521760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.521760] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.523127] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.523259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.524438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.524438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.524438] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a78cf656-0352-46dc-9e26-9fd8a6ca6ce0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.524438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934be84-8ae3-4bd7-9b51-c38b417cac45 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.524821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.524821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.524821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.524821] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934be84-8ae3-4bd7-9b51-c38b417cac45',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.525696] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.525816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.525864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.525996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.526280] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1b710f-8b96-44eb-b935-7e6dcdbe6f18',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.526515] env[65469]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1061.550573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.550774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.551272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.551272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.575710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.575900] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc44b284-72eb-4124-9f75-2904f61a5e37 is going to be deleted. [ 1061.639428] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.639587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.639690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.640173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.640287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.640442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc44b284-72eb-4124-9f75-2904f61a5e37" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.702103] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.702103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.702103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.702103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.728056] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.728056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.728056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.728056] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.749120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.749120] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.749120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.749120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.749120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.749120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.749120] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1061.788732] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.788732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.788732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.788732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.788732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.802193] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1061.958172] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.034318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.034585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.034585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.035518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.035518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.035518] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.037438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.037438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.037438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.037438] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.039468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.039600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.039669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.039855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.039934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.040130] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.040225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.040284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.040422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.040528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.040632] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be deleted. [ 1062.043454] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.043563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.043621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.043776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.043918] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.044024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.044088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.044229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.044308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.044480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.045947] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.046137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.046199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.046425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.046507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.046646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.047019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.047183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.047265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.047350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.047437] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.052256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.052676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.052764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.052968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.053141] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.053263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.053315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.053443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.053525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.053827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.053923] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.065683] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.084671] env[65469]: INFO networking_nsxv3.common.synchronization [req-4a7294e2-2638-4f90-8bea-8340c1e0ec99 req-ec1bce56-3180-404f-aadf-6bb7f6409177 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: e4b8ab7b-310f-4adf-91d6-16b90c64d9ce with Priority: HIGHEST for action security_group_rules [ 1062.094932] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b8ab7b-310f-4adf-91d6-16b90c64d9ce with Priority: HIGHEST for action security_group_rules [ 1062.098497] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.098497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.098497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.098497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.100312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.100312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.100472] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b8ab7b-310f-4adf-91d6-16b90c64d9ce taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.100551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b8ab7b-310f-4adf-91d6-16b90c64d9ce" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.100589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b8ab7b-310f-4adf-91d6-16b90c64d9ce" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.100811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b8ab7b-310f-4adf-91d6-16b90c64d9ce" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.101407] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b8ab7b-310f-4adf-91d6-16b90c64d9ce',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.104127] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.104250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.105048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.105243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.109189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.109189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.111489] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.112178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.112821] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.112913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.113659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.113762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.114533] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.114630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.121887] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.122072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.124334] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.124555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.125104] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1062.125549] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.125664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.126745] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1062.126938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.127089] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9754e57-d686-47f2-9c6f-de699c5ba485 is going to be deleted. [ 1062.128055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.128268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.143111] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.143247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.143312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.143513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.144480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.144480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.157833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.159077] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc2d080-06d1-43db-887c-b69e9dc7db6e is going to be deleted. [ 1062.159179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.159426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.183210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.183210] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8710ede3-753e-4d9b-b6ab-3276d28c0b69 is going to be deleted. [ 1062.183532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.183690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.203104] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.203305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.212855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.212855] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d29c1b7-7d3c-4651-9e62-14cee71b96b1 is going to be deleted. [ 1062.215023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.215023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.231502] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.231705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.231769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.231937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.232139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.232234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.232280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.232853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.232853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.232853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.232853] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.233071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.233071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.233145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.233289] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.233371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.233427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.233558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.233629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.234473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.234473] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.235473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1062.235564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.235715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.235893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.236046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.236153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.236217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.236403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.236467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.236511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.236772] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.245642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.245809] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49239a3f-71c3-4a6e-a70e-4e35fc82c66d is going to be deleted. [ 1062.246724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.247055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.250103] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.250213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.268588] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.268716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.304867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.305011] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a78cf656-0352-46dc-9e26-9fd8a6ca6ce0 is going to be deleted. [ 1062.306047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.306270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.331823] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.331823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.382161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.382315] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934be84-8ae3-4bd7-9b51-c38b417cac45 is going to be deleted. [ 1062.383377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.383914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.452038] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.452219] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.461284] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.494296] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.494296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.516259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.516440] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be deleted. [ 1062.517327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.517640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.547402] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.547562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.547646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.547851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.548023] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.548129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.548188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.548344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.548432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.548693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.548869] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.548968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.549050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.549632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.549632] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.549632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.549632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.549811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.549942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.550054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.550156] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.560361] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.561936] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.562152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.562808] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.564187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.564298] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4d51f5-922c-4c9c-8040-9d222ed7cbcb is going to be deleted. [ 1062.565178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.565388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.568045] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.571568] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5be86bbb-df18-464c-9cd6-f07241444961: rpc.has_security_group_logging(os_id): False [ 1062.630056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.630260] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80280ff5-2173-4569-9e09-d7fdc89693a7 is going to be deleted. [ 1062.631248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.631528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.659498] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.659696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.665093] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.665195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.696037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.696217] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff04faf-b1e3-4f4f-be69-a0b7e048e966 is going to be deleted. [ 1062.697116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.697333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.724904] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.724904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.729031] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1b710f-8b96-44eb-b935-7e6dcdbe6f18 is going to be deleted. [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9754e57-d686-47f2-9c6f-de699c5ba485" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.729031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc2d080-06d1-43db-887c-b69e9dc7db6e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.730596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.731098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.731296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.731581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8710ede3-753e-4d9b-b6ab-3276d28c0b69" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.731820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.732084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.732257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.732483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d29c1b7-7d3c-4651-9e62-14cee71b96b1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.732722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.732960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.733171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.733374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49239a3f-71c3-4a6e-a70e-4e35fc82c66d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.733610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a78cf656-0352-46dc-9e26-9fd8a6ca6ce0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.734569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934be84-8ae3-4bd7-9b51-c38b417cac45" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.735921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.735921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.739508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 1062.740729] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.754488] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.754619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.777664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.777802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.784097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.784250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.807017] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.807244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.807383] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.807668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.807930] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.808222] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.808350] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.808596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.808751] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.809489] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.809489] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.809489] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.809489] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.809489] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.809489] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.809797] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.811562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.811840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.811934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.811995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.812182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.812267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.812363] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 is going to be updated. [ 1062.813783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.813972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.814086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.814230] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b8ab7b-310f-4adf-91d6-16b90c64d9ce already deleted. [ 1062.814280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b8ab7b-310f-4adf-91d6-16b90c64d9ce" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.814406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.814564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.814645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.814760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.815370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.815551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.815638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.815769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4d51f5-922c-4c9c-8040-9d222ed7cbcb" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.816257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.816453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.816536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.816641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80280ff5-2173-4569-9e09-d7fdc89693a7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.817584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.817625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.841488] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.841629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.844642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.844786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.856223] env[65469]: INFO networking_nsxv3.common.synchronization [req-eafabbe6-26c4-4b42-a723-6fcb6bd62323 req-c0b7c088-4538-4bc8-b44c-7ba6aaef9f85 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: 5a106e02-149e-4cd1-9d1e-59e17031bdbd with Priority: HIGHEST for action security_group_rules [ 1062.856870] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a106e02-149e-4cd1-9d1e-59e17031bdbd with Priority: HIGHEST for action security_group_rules [ 1062.857257] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a106e02-149e-4cd1-9d1e-59e17031bdbd taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.857382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a106e02-149e-4cd1-9d1e-59e17031bdbd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.857445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a106e02-149e-4cd1-9d1e-59e17031bdbd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.857702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a106e02-149e-4cd1-9d1e-59e17031bdbd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.857784] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a106e02-149e-4cd1-9d1e-59e17031bdbd',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.876112] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.876344] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.067 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.876491] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.876667] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.877016] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-ab01c7f0-c8ee-4c26-9424-7087e24befff taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.877208] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.877383] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.878113] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.878225] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab01c7f0-c8ee-4c26-9424-7087e24befff',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.880661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.881715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.881715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.881906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.882167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.882261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.882507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.882613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.882680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.882848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.882951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.886138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.886138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.886138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.886138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.886138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.886138] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1062.886690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.886920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.887222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff04faf-b1e3-4f4f-be69-a0b7e048e966" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.887910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.887995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.888138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1b710f-8b96-44eb-b935-7e6dcdbe6f18" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.967671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.968077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.968077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.968351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.968491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.968661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1063.052044] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ff0417e-ec9b-4d09-9e53-7e07d24399c0: rpc.has_security_group_logging(os_id): False [ 1063.062485] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 1063.068356] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e6975d0-2064-42d1-b410-13058e6b3c61: rpc.has_security_group_logging(os_id): False [ 1063.069614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8608a4da-285d-4dc3-aa08-db64404925d5: rpc.has_security_group_logging(os_id): False [ 1063.093356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.093508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.093577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.093926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.095166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.107452] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.107740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.107740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.107928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.108024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.120882] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.121151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.121244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.121678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.125739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1063.126912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.128757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.128995] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: IN_PROGRESS for 2s [ 1063.130396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.130597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.148901] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.148901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.162551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.162551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.162551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.162551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.162551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.162551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.163153] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.163454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.163639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.163950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.164265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.164869] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.165553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.165553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.165553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.165553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.165553] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1063.167047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.167047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.203337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.203337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.215100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.215452] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.215560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.215621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.215830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.215913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.216023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1063.217483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.217782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.243614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1800bc34-66c0-4e6c-973e-252547c5c4e1: rpc.has_security_group_logging(os_id): False [ 1063.353981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.354332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.384571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.385059] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.385212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.385286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.385507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.385627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.385698] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1063.386952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.387201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.387394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.389184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.389419] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.390929] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.391176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.391303] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.391625] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.391777] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.391933] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port ab01c7f0-c8ee-4c26-9424-7087e24befff not found, creating... [ 1063.392239] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.392412] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.392534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.392773] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.392934] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.393282] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.393450] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.393598] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.393806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.393943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.394097] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: ab01c7f0-c8ee-4c26-9424-7087e24befff is going to be created. [ 1063.441020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.441275] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.540606] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.540606] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.540829] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.541068] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.541453] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.541878] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.558025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.558298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.562779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.563184] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.563346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.563402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.563619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.563762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.563904] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1063.565224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.565456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.565587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.565888] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.565986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.566071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.566284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.566386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.566482] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be created. [ 1063.567720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.567934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.568059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.568173] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a106e02-149e-4cd1-9d1e-59e17031bdbd already deleted. [ 1063.568274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a106e02-149e-4cd1-9d1e-59e17031bdbd" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.569633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.569779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.569832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.570660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.570660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.571546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.571725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.571862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.609910] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1063.622254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1063.649665] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1063.723336] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.723450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.723531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.723737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.724107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.759655] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.759655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.759655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.759986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.759986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.790047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1063.798082] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1063.825252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.825252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.825252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.825252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.825252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.831502] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1063.832822] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 deletion is rescheduled due to dependency. [ 1063.832959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.871235] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1063.871235] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1064.135521] env[65469]: INFO networking_nsxv3.common.synchronization [req-e73b11c9-fd62-4e46-b138-c59355d7fbcf req-1edc80fb-4ff7-4a41-9772-c0a041294eb2 service nova] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_rules [ 1064.135521] env[65469]: INFO networking_nsxv3.common.synchronization [req-e73b11c9-fd62-4e46-b138-c59355d7fbcf req-1edc80fb-4ff7-4a41-9772-c0a041294eb2 service nova] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1064.137528] env[65469]: INFO networking_nsxv3.common.synchronization [req-e73b11c9-fd62-4e46-b138-c59355d7fbcf req-1edc80fb-4ff7-4a41-9772-c0a041294eb2 service nova] Enqueued Resource ID: ab01c7f0-c8ee-4c26-9424-7087e24befff with Priority: HIGHEST for action port [ 1064.138478] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_rules [ 1064.138697] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1064.138886] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab01c7f0-c8ee-4c26-9424-7087e24befff with Priority: HIGHEST for action port [ 1064.139376] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.139546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.139639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.139923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.140061] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.141180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.141431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.141572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.141754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.142673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.142791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.142860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.143091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.143449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.143449] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.144284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab01c7f0-c8ee-4c26-9424-7087e24befff taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.144499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.144499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.144664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.144703] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab01c7f0-c8ee-4c26-9424-7087e24befff',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.386454] env[65469]: INFO networking_nsxv3.common.synchronization [req-4a15634c-d3ab-4a18-bc48-0d6689b32001 req-c6cefe11-34f2-4ceb-97f3-9207e8818306 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: 63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0 with Priority: HIGHEST for action security_group_rules [ 1064.388163] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0 with Priority: HIGHEST for action security_group_rules [ 1064.388716] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.389331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.389542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.389787] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.389865] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.647949] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.647949] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.647949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.647949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab01c7f0-c8ee-4c26-9424-7087e24befff with status ACTIVE [ 1064.648554] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.648554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.648554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.648554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.648710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.648744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.648920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.648920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.649353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.649530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.649805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.649937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.650030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.650217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.651138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.651138] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab01c7f0-c8ee-4c26-9424-7087e24befff is going to be updated. [ 1064.655597] env[65469]: INFO networking_nsxv3.common.synchronization [req-4502d529-6639-41f6-a62a-a8a1bb29ca65 req-3e901395-1413-45bf-ac32-1fb8e5f5a9a6 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1064.656826] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1064.657062] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.657193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.657255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.657515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.657676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.657780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.657834] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.658055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.658106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.658164] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.673017] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.673167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.673243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.673482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.673638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.673803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.920914] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.922254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.922254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.922254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.922254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.922254] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0 already deleted. [ 1064.922254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ef752a-5e16-49e0-96a5-3d2ffcd0eaa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.061797] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.061971] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.062133] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.062460] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.062978] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.063300] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.063403] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.063688] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.063972] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.064342] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.064342] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.064509] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.064679] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.064837] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.065007] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.065213] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.090026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.090026] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.090026] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.090026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.090026] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-63316125-b00a-498a-83d1-aa82e38cbc20 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.090026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.090026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.090026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.090026] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63316125-b00a-498a-83d1-aa82e38cbc20',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.115864] env[65469]: INFO networking_nsxv3.common.synchronization [req-87d4e7c8-32de-4ad1-913b-a2307585648b req-726c98bf-a2a5-4a53-8afd-cfda42a9a6b0 tempest-ServerAddressesNegativeTestJSON-588148369 tempest-ServerAddressesNegativeTestJSON-588148369-project-member] Enqueued Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1065.116394] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGHEST for action security_group_members [ 1065.122553] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.122704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.122773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.123439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.123683] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.123818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.123901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.124100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.124215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.124329] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.137987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1065.138329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.141069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.141069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.141069] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.145342] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: SUCCESS [ 1065.145342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.149028] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.161346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.161579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.161662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.161885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.161986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.162203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.162296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.162358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.162515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.162590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.162694] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 already deleted. [ 1065.162862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.592601] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.593035] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.593035] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.595772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.595772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.595772] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 63316125-b00a-498a-83d1-aa82e38cbc20 not found, creating... [ 1065.595772] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.595772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.595772] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.596966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.596966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.600621] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.600621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.600621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.600621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.600621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.600621] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 63316125-b00a-498a-83d1-aa82e38cbc20 is going to be created. [ 1065.628884] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.629366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.629366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.629562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.629790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.630187] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.631300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.631901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.632262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.632824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.635118] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1065.635428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.636227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.636469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.636646] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.649562] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.649562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.649775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.650086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.650086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.650238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.650289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.652806] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.652806] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.652806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.652806] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.654960] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.654960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.654960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.654960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.654960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.654960] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be created. [ 1065.698499] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1065.699207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.706108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.706108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.706108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.706108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706108] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d287eaed-f226-46a7-8661-38075c224166 is going to be updated. [ 1065.716305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1065.716671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.745666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.745849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.745919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.746295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.746517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.777849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: UNINITIALIZED for 2s [ 1065.788629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.788887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.789068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.789460] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.789650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.810299] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: IN_PROGRESS for 2s [ 1065.816374] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1065.816719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.817624] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1065.817882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.913567] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1065.913898] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.088804] env[65469]: INFO networking_nsxv3.common.synchronization [req-271e69da-cce7-4a61-9530-4c102c5be080 req-16b5b0de-34f1-4000-80dd-6882fc7352ec tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: fe173ec7-e8c5-4a19-a06f-bb562a1e3118 with Priority: HIGHEST for action security_group_rules [ 1066.089442] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe173ec7-e8c5-4a19-a06f-bb562a1e3118 with Priority: HIGHEST for action security_group_rules [ 1066.089759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe173ec7-e8c5-4a19-a06f-bb562a1e3118 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.089895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe173ec7-e8c5-4a19-a06f-bb562a1e3118" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.089976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe173ec7-e8c5-4a19-a06f-bb562a1e3118" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.090302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe173ec7-e8c5-4a19-a06f-bb562a1e3118" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.090419] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe173ec7-e8c5-4a19-a06f-bb562a1e3118',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.139926] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.140407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.140407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.140761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.141215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.141215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.141604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.141694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.141789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.141863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.141923] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.158978] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 1066.183188] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.183607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.183607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.183607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.209435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.209784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.209908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.209958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.210657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.210657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.210657] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.210862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.210862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.210998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.213442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.213442] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.213442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.213442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.213442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.213442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.213442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1066.360862] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.361133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.361262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.362201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.362201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.383402] env[65469]: INFO networking_nsxv3.common.synchronization [req-4502d529-6639-41f6-a62a-a8a1bb29ca65 req-fc75f18c-9a14-42bc-b253-375250c6ef93 service nova] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1066.383402] env[65469]: INFO networking_nsxv3.common.synchronization [req-4502d529-6639-41f6-a62a-a8a1bb29ca65 req-fc75f18c-9a14-42bc-b253-375250c6ef93 service nova] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1066.383402] env[65469]: INFO networking_nsxv3.common.synchronization [req-4502d529-6639-41f6-a62a-a8a1bb29ca65 req-fc75f18c-9a14-42bc-b253-375250c6ef93 service nova] Enqueued Resource ID: 63316125-b00a-498a-83d1-aa82e38cbc20 with Priority: HIGHEST for action port [ 1066.383402] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_rules [ 1066.385079] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1066.385079] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63316125-b00a-498a-83d1-aa82e38cbc20 with Priority: HIGHEST for action port [ 1066.385079] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.385385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.385385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.385576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.385626] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.387479] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.387653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.387704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.388026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.388151] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.388293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.388293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.389826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.389826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.389826] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.390086] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-63316125-b00a-498a-83d1-aa82e38cbc20 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.390086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.390086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.390267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.390954] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63316125-b00a-498a-83d1-aa82e38cbc20',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.393274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1066.615312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.615457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.615534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.615739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.615831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.615923] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe173ec7-e8c5-4a19-a06f-bb562a1e3118 already deleted. [ 1066.616014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe173ec7-e8c5-4a19-a06f-bb562a1e3118" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.645965] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.645965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.645965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.646267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.646267] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.646506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.646506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.646506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.646665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.646665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.646963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.647069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.647119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.647235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.647376] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.647470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.647529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.647672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.647749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.647830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.647918] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.839753] env[65469]: INFO networking_nsxv3.common.synchronization [None req-cb2f7343-455e-4207-8ebb-beabd82967a3 tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 with Priority: HIGHEST for action security_group_rules [ 1066.839753] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 with Priority: HIGHEST for action security_group_rules [ 1066.840234] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.840538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.840734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.841094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.841321] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed5347a-1c8a-4255-a4cc-ca73824f2497',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.892212] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.895022] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.895022] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63316125-b00a-498a-83d1-aa82e38cbc20 with status ACTIVE [ 1066.895022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.895022] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.895022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.895885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.896706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.896944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.897288] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.900023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.900023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.900023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.900023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.900023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63316125-b00a-498a-83d1-aa82e38cbc20 is going to be updated. [ 1066.925033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.925269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.925269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.925531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.925670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.925869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63316125-b00a-498a-83d1-aa82e38cbc20" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.943027] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a27e7bf1-a351-45d3-8733-335beae22619 tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 with Priority: HIGHEST for action security_group_rules [ 1066.943027] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 with Priority: HIGHEST for action security_group_rules [ 1066.943027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.943027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.150119] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 1067.171978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.172269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.172398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.172855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.173067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.174386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.174386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174386] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.175582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.175582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.176254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.176254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.176254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.176254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.176477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.176657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1067.276564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.276830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.277745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.277745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.277745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.313763] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1067.399026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.399026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 already deleted. [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.399026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.399026] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed5347a-1c8a-4255-a4cc-ca73824f2497',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.401087] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.523278] env[65469]: INFO networking_nsxv3.common.synchronization [req-1866e08a-c31a-4482-9882-c5eafc720973 req-9465807c-28d2-46c5-b249-4cf208bbb955 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1067.523848] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1067.524182] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccd364c-9467-49f8-9963-d3bae9805311 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.524309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.524377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.524638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.524722] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccd364c-9467-49f8-9963-d3bae9805311',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.729507] env[65469]: INFO networking_nsxv3.common.synchronization [req-5315b4a1-49a5-4c8d-bfdf-38f139b7436d req-f304f28a-007b-4b33-8b6e-0dd8cc69ed15 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1067.729760] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1067.730049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccd364c-9467-49f8-9963-d3bae9805311 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.730215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.791563] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 1067.791814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.791995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.792254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.792458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.792659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.792659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.792850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.792908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.793015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.793094] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.821764] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d287eaed-f226-46a7-8661-38075c224166 in Status: SUCCESS [ 1067.821764] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d287eaed-f226-46a7-8661-38075c224166 deletion is rescheduled due to dependency. [ 1067.821892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.905160] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.905363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.905363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.905863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.905982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.906116] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 is going to be created. [ 1067.926927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.927494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.927494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.927743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.927853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.927983] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed5347a-1c8a-4255-a4cc-ca73824f2497 already deleted. [ 1067.928105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed5347a-1c8a-4255-a4cc-ca73824f2497" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.976407] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.976595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.976668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.976959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.977189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.992245] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: UNINITIALIZED for 2s [ 1068.078476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.078476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.078476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.078476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.079206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.079206] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccd364c-9467-49f8-9963-d3bae9805311 already deleted. [ 1068.079206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.079206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.079206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.079510] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccd364c-9467-49f8-9963-d3bae9805311',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.295886] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.296647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.296843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.297162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.297887] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.298116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.298308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.298590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.298775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.299708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.299708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.299708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.299708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.299708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.299708] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.300126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.300126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.300126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.300126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.301289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.301289] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.413042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1068.413279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.413502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.414260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.414260] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.604252] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.604446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.604515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.604720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.604871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.604988] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccd364c-9467-49f8-9963-d3bae9805311 already deleted. [ 1068.605103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.638099] env[65469]: INFO networking_nsxv3.common.synchronization [req-1fc01b47-6dba-4873-bd0b-6b6b1c039abb req-836c55b3-af30-442b-a518-78f4c2648b70 tempest-SecurityGroupRulesTestJSON-928469563 tempest-SecurityGroupRulesTestJSON-928469563-project-member] Enqueued Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1068.638759] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccd364c-9467-49f8-9963-d3bae9805311 with Priority: HIGHEST for action security_group_rules [ 1068.639321] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccd364c-9467-49f8-9963-d3bae9805311 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.640107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.640197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.640662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.640662] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccd364c-9467-49f8-9963-d3bae9805311',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.787958] env[65469]: INFO networking_nsxv3.common.synchronization [req-70d5cf59-1146-430c-8379-96f550ba078b req-c62619e2-9d0a-481a-a46a-f9bb3e384851 tempest-ServersAdminNegativeTestJSON-1911609592 tempest-ServersAdminNegativeTestJSON-1911609592-project-member] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1068.788695] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1068.789144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.789352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.789352] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.789601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.789759] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.789759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.789879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.790030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.790084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.790198] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.802947] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dac16e76-d38a-4051-af09-b9b6e58acda0: rpc.has_security_group_logging(os_id): False [ 1068.825338] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.825486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.825586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.826125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.826291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.826593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.826698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.826759] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.826920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.828314] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.828314] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.828314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.828987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.828987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be created. [ 1068.916553] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.916721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.916855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.917189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.917458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.917587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.917696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.917952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.918098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.918326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.918435] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.925589] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.925589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.925589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.928119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.928119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.947500] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: IN_PROGRESS for 2s [ 1069.167537] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.167537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.167794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.167909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.168011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.168049] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccd364c-9467-49f8-9963-d3bae9805311 already deleted. [ 1069.172022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccd364c-9467-49f8-9963-d3bae9805311" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.293476] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.333672] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1069.334200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.421453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.421698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.421777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.421998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.422243] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.422417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.422495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.422744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.422866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.422950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.423138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.423309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.423309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.423488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.423666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.423842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.424053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.424119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.424235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.424368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.424368] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.798501] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.929036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0450b87-9656-4a30-b7b0-3f5285ac5d52: rpc.has_security_group_logging(os_id): False [ 1069.948382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.948585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.948585] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.948722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.948815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.949064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.949196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.949269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.949489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.949602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.949807] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.949906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.949969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.950307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.950389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.950578] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.950673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.950735] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.950890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.950980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.951045] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1070.005077] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: SUCCESS [ 1070.005307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.005476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.005686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.005874] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.005988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.006060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.006208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.006285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.006366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.006484] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.029371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.029614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.029697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.029975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.030461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.063510] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1070.301126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.301310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.301359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.304863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.304863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.304863] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1070.340273] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.340658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.340658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.340658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.340871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.353882] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1070.509618] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.995452] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 1070.995452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.013848] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bf5e51a-42c7-4d46-b6da-54474ae7b623: rpc.has_security_group_logging(os_id): False [ 1071.047020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.047020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.047020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.047338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.047338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.047338] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 is going to be created. [ 1071.160791] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.160955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.161033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.161379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.161521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.186032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: IN_PROGRESS for 2s [ 1071.754440] env[65469]: INFO networking_nsxv3.common.synchronization [req-e3be4b74-8f9c-4f55-ae6b-b7c764ebafb0 req-2e6b3a2b-5b23-4d05-a58e-2011b57dc080 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1071.755179] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1071.755460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.755621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.755682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.756177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.758910] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.759575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.759575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.759575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.759575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.759754] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.084895] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1072.085153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.262935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.369202] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1072.369840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.765102] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.201577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: SUCCESS [ 1073.202324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.268963] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.269176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.269241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.269596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.269986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.269986] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1073.308572] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.308572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.308572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.308572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.308572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.322402] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1074.560480] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc7dea2a-a143-4550-90c1-146feb7d55ab req-7f6539f1-0569-4e0c-ba3b-2152018b5ff6 tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1074.561075] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1074.562291] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.562291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.562291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.562291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.562291] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.562291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.562646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.562646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.562646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.562745] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.910773] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.910990] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.911116] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.911395] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.911777] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.911947] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.912077] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.912309] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.912457] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.912764] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.913270] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.913270] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.913270] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.913270] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.913577] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.913577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.935460] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.935993] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.936153] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.936526] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.937299] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-ab09af4b-ad24-41a5-a78a-f8a918205d48 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.937588] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.938434] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.939102] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.939379] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab09af4b-ad24-41a5-a78a-f8a918205d48',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.065034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.065284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.065650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.065770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.066324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.066670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.066816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.066911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.067178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.067304] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.067407] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1075.100499] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.100695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.100765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.100976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.101198] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.115050] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1075.342847] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1075.343126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.441672] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.441938] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.442088] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.442376] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.442549] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.442711] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port ab09af4b-ad24-41a5-a78a-f8a918205d48 not found, creating... [ 1075.442977] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.443157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.443286] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.443533] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.443670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.443962] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.444126] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.444244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.444541] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.444684] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.444822] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: ab09af4b-ad24-41a5-a78a-f8a918205d48 is going to be created. [ 1075.465190] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.465432] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.465487] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.465753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.466116] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.466342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.977965] env[65469]: INFO networking_nsxv3.common.synchronization [req-e7fe04a2-b2be-4244-8ad8-09b04e90be58 req-27b32d98-61a6-4aa4-87b3-9191e0108b5e tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1075.978556] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac16e76-d38a-4051-af09-b9b6e58acda0 with Priority: HIGHEST for action security_group_members [ 1075.979147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac16e76-d38a-4051-af09-b9b6e58acda0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.979147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.979147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.979338] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.979393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.979509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.979563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.979702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.979781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.979871] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac16e76-d38a-4051-af09-b9b6e58acda0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.020849] env[65469]: INFO networking_nsxv3.common.synchronization [req-e7fe04a2-b2be-4244-8ad8-09b04e90be58 req-27b32d98-61a6-4aa4-87b3-9191e0108b5e tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: ab01c7f0-c8ee-4c26-9424-7087e24befff with Priority: HIGHEST for action port [ 1076.021414] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab01c7f0-c8ee-4c26-9424-7087e24befff with Priority: HIGHEST for action port [ 1076.021810] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab01c7f0-c8ee-4c26-9424-7087e24befff taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.021970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.022176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.022398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.022530] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab01c7f0-c8ee-4c26-9424-7087e24befff',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.177363] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc7dea2a-a143-4550-90c1-146feb7d55ab req-a14f13e3-1124-4ed5-8252-e68058ba7c79 service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1076.177538] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc7dea2a-a143-4550-90c1-146feb7d55ab req-a14f13e3-1124-4ed5-8252-e68058ba7c79 service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1076.177679] env[65469]: INFO networking_nsxv3.common.synchronization [req-bc7dea2a-a143-4550-90c1-146feb7d55ab req-a14f13e3-1124-4ed5-8252-e68058ba7c79 service nova] Enqueued Resource ID: ab09af4b-ad24-41a5-a78a-f8a918205d48 with Priority: HIGHEST for action port [ 1076.178207] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1076.178344] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1076.178441] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab09af4b-ad24-41a5-a78a-f8a918205d48 with Priority: HIGHEST for action port [ 1076.178719] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.179194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.179194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.179360] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.179524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.333677] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.333930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.334199] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab09af4b-ad24-41a5-a78a-f8a918205d48 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.334301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.334394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.334688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.334763] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab09af4b-ad24-41a5-a78a-f8a918205d48',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.483687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.483876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.483949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.484191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.484282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.484614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.484614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.484741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.484796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.484893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.484942] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 is going to be updated. [ 1076.515462] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.515743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.515743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.515879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.516013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.524970] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: IN_PROGRESS for 2s [ 1076.525187] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab01c7f0-c8ee-4c26-9424-7087e24befff with status ACTIVE [ 1076.525394] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.525520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.525595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.525789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.525877] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.526180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.526180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.526343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.526387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.526477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.526652] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.526746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.526803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.526946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.527031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.527252] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab01c7f0-c8ee-4c26-9424-7087e24befff is going to be updated. [ 1076.549863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.550184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.550184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.550321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.550407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.550562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab01c7f0-c8ee-4c26-9424-7087e24befff" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.780450] env[65469]: INFO networking_nsxv3.common.synchronization [req-3f5f3843-2a74-4d47-a419-f2e22e94d3f6 req-3e8555b8-f760-418d-a55b-617f55dad0e4 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1076.781099] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1076.782868] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.783710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.783710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.783710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.783710] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.783710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.783949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.783985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.784463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.784463] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.836477] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.837108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.838886] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab09af4b-ad24-41a5-a78a-f8a918205d48 with status ACTIVE [ 1076.839266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.839426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.839473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.839855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.839910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.840173] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.840248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.840289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.840504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.840504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.840677] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.840771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.840825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.840959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.841036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.841124] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab09af4b-ad24-41a5-a78a-f8a918205d48 is going to be updated. [ 1076.865064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.865436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.865436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.865672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.865843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.866356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab09af4b-ad24-41a5-a78a-f8a918205d48" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.126148] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1077.126148] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 deletion is rescheduled due to dependency. [ 1077.126148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.126148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.126758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.126758] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.126758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.126758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.126952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.126952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.127064] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.288700] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.288700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.288700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.288700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.322172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.322172] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.322172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.322339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.322421] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.322516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.323682] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1077.362590] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.362770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.362839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.363244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.363244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.379237] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1077.630512] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.132459] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.536985] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac16e76-d38a-4051-af09-b9b6e58acda0 in Status: SUCCESS [ 1078.537222] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac16e76-d38a-4051-af09-b9b6e58acda0 deletion is rescheduled due to dependency. [ 1078.537357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac16e76-d38a-4051-af09-b9b6e58acda0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.635366] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.635612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.635612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.635809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.635903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.636021] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1078.667102] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.667102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.667102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.667553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.667553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.677743] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1079.391440] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1079.391818] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 1079.391818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.526113] env[65469]: INFO networking_nsxv3.common.synchronization [req-27c177f2-b1fa-4b4c-8440-56e241b71cd1 req-071decc8-f8a6-448b-910f-ffa40f02e4b7 tempest-ServersAdminNegativeTestJSON-1911609592 tempest-ServersAdminNegativeTestJSON-1911609592-project-member] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1079.526693] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGHEST for action security_group_members [ 1079.527070] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.527872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.527988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.528257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.528485] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.528632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.528719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.528908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.529027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.529157] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.032715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.032969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.032969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.033200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.033292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.033534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.033672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.033725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.033899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.033978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.034089] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be updated. [ 1080.067392] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.067584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.068420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.068420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.068420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.077692] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: IN_PROGRESS for 2s [ 1080.691159] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1080.691429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.691642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.691838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.692040] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.692159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.692224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.692373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.692453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.692535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.692625] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.195534] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.195751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.195751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.195751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.231670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.231670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.231670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.231670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.231670] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.701920] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd6b3522-babc-4977-91f4-6a81f2f59e88: rpc.has_security_group_logging(os_id): False [ 1081.724025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.724025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.724025] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.724025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.724633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.724633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.724633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.724633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.724633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.724633] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1081.829552] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.829777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.829996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.830279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.830517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.850072] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1082.090058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 in Status: SUCCESS [ 1082.090237] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 deletion is rescheduled due to dependency. [ 1082.090357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.668430] env[65469]: INFO networking_nsxv3.common.synchronization [req-eb5dc5c5-ee9d-4d38-bc0b-ed5657e1f684 req-cd2c9630-1bac-4add-8f75-3c97d7c02e59 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1082.669534] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1082.670053] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.670212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.670347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.670514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.670670] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.670753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.670822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.670977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.671070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.671164] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.052617] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.053085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.053085] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.053228] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.053489] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.053644] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.053760] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.053981] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.054151] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.054399] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.054547] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.054764] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.054959] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.055143] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.055255] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.055391] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.108508] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.108766] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.108987] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.109356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.109762] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.110026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.110249] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.110783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.110993] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcaade9d-dc61-46c4-a36f-3c9ca790ea1f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.176067] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.613803] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.614105] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.615063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.615063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.615063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.615200] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port bcaade9d-dc61-46c4-a36f-3c9ca790ea1f not found, creating... [ 1083.615628] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.615907] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.616219] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.616537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.616784] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.617288] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.617550] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.617783] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.618158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.618341] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.618554] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: bcaade9d-dc61-46c4-a36f-3c9ca790ea1f is going to be created. [ 1083.650878] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.651148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.651581] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.651581] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.651750] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.651979] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.679262] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.875708] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1083.876054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.182701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.183149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.183149] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.183217] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.183336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.183447] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be updated. [ 1084.220524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.220819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.220819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.220995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.221167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.231641] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1084.376025] env[65469]: INFO networking_nsxv3.common.synchronization [req-eb5dc5c5-ee9d-4d38-bc0b-ed5657e1f684 req-d50fdeed-90db-4623-8324-8519e821b32c service nova] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1084.376223] env[65469]: INFO networking_nsxv3.common.synchronization [req-eb5dc5c5-ee9d-4d38-bc0b-ed5657e1f684 req-d50fdeed-90db-4623-8324-8519e821b32c service nova] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1084.376445] env[65469]: INFO networking_nsxv3.common.synchronization [req-eb5dc5c5-ee9d-4d38-bc0b-ed5657e1f684 req-d50fdeed-90db-4623-8324-8519e821b32c service nova] Enqueued Resource ID: bcaade9d-dc61-46c4-a36f-3c9ca790ea1f with Priority: HIGHEST for action port [ 1084.377258] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_rules [ 1084.377422] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1084.377532] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcaade9d-dc61-46c4-a36f-3c9ca790ea1f with Priority: HIGHEST for action port [ 1084.377838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.377944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.378026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.378266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.378351] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.380018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.380018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.380601] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.380601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.380843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.381113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.381293] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcaade9d-dc61-46c4-a36f-3c9ca790ea1f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.884468] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.884468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.888749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcaade9d-dc61-46c4-a36f-3c9ca790ea1f with status ACTIVE [ 1084.888749] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.888749] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.888749] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.888749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.888749] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcaade9d-dc61-46c4-a36f-3c9ca790ea1f is going to be updated. [ 1084.918700] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.918954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.919059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.919328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.919558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.919772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcaade9d-dc61-46c4-a36f-3c9ca790ea1f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.025411] env[65469]: INFO networking_nsxv3.common.synchronization [req-cb1723e6-4487-4a6a-8995-5227e06a2ea8 req-32f92918-1e0c-42cb-b45d-3a6f2acd8ad8 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1085.026033] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1085.027184] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.027184] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.027184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.027543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.027543] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.414699] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.415226] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.415226] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.415344] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.415631] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.415809] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.415937] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.416193] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.416341] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.416548] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.417260] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.417260] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.417260] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.417260] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.417260] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.417516] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.437564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.437765] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.437918] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.438113] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-898" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.438437] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-48e086e2-ce59-4174-bdb1-dc8f78c271d7 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.438603] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.438725] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.439669] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.439669] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e086e2-ce59-4174-bdb1-dc8f78c271d7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.530056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.530241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.530241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.530451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.530565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.530746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.530856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.530944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.531303] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1085.562628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.562827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.562827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.563046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.563165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.572362] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1085.941567] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.942761] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.943079] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.943425] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.943588] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.943757] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 48e086e2-ce59-4174-bdb1-dc8f78c271d7 not found, creating... [ 1085.944051] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.944227] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.944349] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.944585] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.944726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.945378] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.945598] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.945722] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.945944] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.946596] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.946596] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 48e086e2-ce59-4174-bdb1-dc8f78c271d7 is going to be created. [ 1085.967824] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.968054] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.968208] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.969044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.969044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.969044] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.244593] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.244593] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.244593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.244593] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.746046] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.185219] env[65469]: INFO networking_nsxv3.common.synchronization [req-cb1723e6-4487-4a6a-8995-5227e06a2ea8 req-0d519810-87a8-4ee1-b6c2-be2f9331f247 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 1087.185316] env[65469]: INFO networking_nsxv3.common.synchronization [req-cb1723e6-4487-4a6a-8995-5227e06a2ea8 req-0d519810-87a8-4ee1-b6c2-be2f9331f247 service nova] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1087.185457] env[65469]: INFO networking_nsxv3.common.synchronization [req-cb1723e6-4487-4a6a-8995-5227e06a2ea8 req-0d519810-87a8-4ee1-b6c2-be2f9331f247 service nova] Enqueued Resource ID: 48e086e2-ce59-4174-bdb1-dc8f78c271d7 with Priority: HIGHEST for action port [ 1087.186181] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_rules [ 1087.186438] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1087.186512] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e086e2-ce59-4174-bdb1-dc8f78c271d7 with Priority: HIGHEST for action port [ 1087.186784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.186990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.187126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.187362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.187435] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.188309] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.188463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.188679] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e086e2-ce59-4174-bdb1-dc8f78c271d7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.188802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.188945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.189053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.189114] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e086e2-ce59-4174-bdb1-dc8f78c271d7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.248768] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.587405] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1087.588118] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 1087.588118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.588252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.588505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.588718] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.588851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.588925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.589085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.589210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.589334] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.691178] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.691368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.691658] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48e086e2-ce59-4174-bdb1-dc8f78c271d7 with status ACTIVE [ 1087.692387] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.692607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.692607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.692906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.693087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.693728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.694059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.694059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.694257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.694393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.694694] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.694846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.694891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.695230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.695230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.695307] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48e086e2-ce59-4174-bdb1-dc8f78c271d7 is going to be updated. [ 1087.724740] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.724887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.724976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.725322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.725455] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.725656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e086e2-ce59-4174-bdb1-dc8f78c271d7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.752651] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.753157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.753157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.753249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.753339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.753473] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be updated. [ 1087.811775] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.811986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.812055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.812305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.812497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.835067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1088.092785] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.299407] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f67cb73-0e5f-4f6a-9cfd-49551baa17a7 req-7874bf2d-26e4-4632-8fa1-bac22f502f54 tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1088.301088] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1088.301251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.301370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.302793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.302793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.302793] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.594908] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.748948] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.749314] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.749569] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.750102] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.750596] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.750880] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.751124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.751529] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.751728] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.752027] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.752169] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.752342] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.752512] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.752758] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.753037] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.753169] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.780852] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.781061] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.781204] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.781426] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-750" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.781933] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782225] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.782359] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.782810] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.783012] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e51a06-b541-46e1-a7dd-e10b0a5d49aa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.808680] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.100031] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.100031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.100031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.100031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.100031] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.100031] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1089.135196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.135196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.135196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.135196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.135453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.144973] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1089.285727] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.285956] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.286103] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.286413] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.286590] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.286754] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port b0e51a06-b541-46e1-a7dd-e10b0a5d49aa not found, creating... [ 1089.287077] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.287250] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.287368] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.287595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.287734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.288158] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.288368] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.288523] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.288771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.288951] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.289140] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: b0e51a06-b541-46e1-a7dd-e10b0a5d49aa is going to be created. [ 1089.313713] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.313998] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.314148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.314424] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.314677] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.314909] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.315733] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.817472] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.817798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.817798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.817918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.818024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.818224] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1089.845100] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1089.845242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.845481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.845731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.845953] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.846115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.846191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.846353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.846426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.846516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.846619] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.853397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.853552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.853642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.853921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.854168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.864436] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1090.027973] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f67cb73-0e5f-4f6a-9cfd-49551baa17a7 req-de329f9d-8e66-4c85-9b32-b9e61ac6c567 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 1090.027973] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f67cb73-0e5f-4f6a-9cfd-49551baa17a7 req-de329f9d-8e66-4c85-9b32-b9e61ac6c567 service nova] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1090.028188] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f67cb73-0e5f-4f6a-9cfd-49551baa17a7 req-de329f9d-8e66-4c85-9b32-b9e61ac6c567 service nova] Enqueued Resource ID: b0e51a06-b541-46e1-a7dd-e10b0a5d49aa with Priority: HIGHEST for action port [ 1090.028608] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_rules [ 1090.028808] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1090.028960] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e51a06-b541-46e1-a7dd-e10b0a5d49aa with Priority: HIGHEST for action port [ 1090.029407] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.029691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.029691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.029828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.029900] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.031034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.031034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.031284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.031416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.031484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.031732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.031811] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e51a06-b541-46e1-a7dd-e10b0a5d49aa',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.349802] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.534082] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.534309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.534423] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e51a06-b541-46e1-a7dd-e10b0a5d49aa with status ACTIVE [ 1090.534808] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.534808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.534808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.535034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.535072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.535251] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.535343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.535379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.535512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.535589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.535768] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.535858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.535931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.536060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.536133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.536214] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e51a06-b541-46e1-a7dd-e10b0a5d49aa is going to be updated. [ 1090.561915] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.562121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.562184] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.562354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.562491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.562705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e51a06-b541-46e1-a7dd-e10b0a5d49aa" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.852675] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1800bc34-66c0-4e6c-973e-252547c5c4e1: rpc.has_security_group_logging(os_id): False [ 1090.872754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.872914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.872961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.873189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.873280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.873524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.873624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.873693] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.873828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.873899] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.874036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be updated. [ 1090.942588] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.942808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.942860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.943076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.943316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.958794] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1091.157389] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1091.157613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.157791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.158051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.158254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.158376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.158443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.158600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.158683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.158767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.158854] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.662104] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.662104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.662104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.662366] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.662366] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.662495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.662641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.662890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.662985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.663115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.663266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.663377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.663440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.663671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.663941] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.664078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.664187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.664393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.664506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.664618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.664732] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.876124] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1091.876473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.876530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.876764] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.876953] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.877091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.877135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.877331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.877416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.877475] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.167225] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d: rpc.has_security_group_logging(os_id): False [ 1092.188415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.188716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.188825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.188995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.189102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.189314] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.189417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.189520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.189742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.189847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.190069] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.190164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.190230] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.190363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.190436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.190743] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.190978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.191055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.191200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.191271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.191365] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1092.259085] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.259375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.259375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.259505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.259823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.273931] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1092.380806] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.882741] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.980161] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1092.980441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.385721] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.386296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.386296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.386422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.386504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.386657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1093.417342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.417529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.417569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.418139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.418139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.430622] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1093.597374] env[65469]: INFO networking_nsxv3.common.synchronization [None req-79ffb828-6af0-4b1e-98f6-c9b41a24dd9e tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1093.598153] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1093.598500] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.598632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.598700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.599194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.599194] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.599194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.599194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.599441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.599441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.599635] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.103470] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.103796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.103880] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.104285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.104466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.104743] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.104921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.104997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.105157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.105238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.105394] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be deleted. [ 1094.147923] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.148245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.148319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.148559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.148701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.148793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.304383] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1094.304676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.440932] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1095.441207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.441361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.441579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.441815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.441934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.442009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.442158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.442268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.442324] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.442402] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.944881] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.945028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.945028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.945233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.945383] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.945488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.945611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.945790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.945843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.946536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.946536] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.946536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.946536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.946536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.946715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.946766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.946823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.946976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.947071] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.947153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.947247] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.450515] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 709a1070-5186-40a8-ad7e-f0a18412647f: rpc.has_security_group_logging(os_id): False [ 1096.469461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.469611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.469729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.469971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.470120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.470348] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.470463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.470517] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.470724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.470802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.470988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.471674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.471674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.471932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.471932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.471984] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1096.537396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.537554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.537623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.537820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.537965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.553682] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1098.573211] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1098.573529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.599115] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1098.599309] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1100.208290] env[65469]: INFO networking_nsxv3.common.synchronization [req-d366fccb-d04c-4ad4-9ded-2e844a6a1337 req-2971d509-6ee6-4166-8b8b-0bff9498bcae tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1100.209322] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1100.209617] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.209790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.209861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.210170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.210339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.210501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.210649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.211256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.211256] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.211256] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.595502] env[65469]: INFO networking_nsxv3.common.synchronization [req-e347e1fe-083b-4c23-9ea9-85045b42be58 req-bbdc41b1-70c2-4464-8237-e096cb1ee492 tempest-ServerDiskConfigTestJSON-1498547308 tempest-ServerDiskConfigTestJSON-1498547308-project-member] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1100.596155] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGHEST for action security_group_members [ 1100.597921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.597921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.597921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.597921] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.715681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.715681] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.715681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.715681] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1100.759518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.759781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.760051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.760241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.771168] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1101.100034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.100195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.100270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.100493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.100594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.100800] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.100897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.100958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.101123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.101200] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.101281] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be updated. [ 1101.133059] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.133223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.133223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.133407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.133544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.143403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: IN_PROGRESS for 2s [ 1102.718742] env[65469]: INFO networking_nsxv3.common.synchronization [req-5cce84d5-b7da-484a-ab83-4ea31e2024ed req-ef39e9b8-5c44-4d3e-badc-5298b584515d tempest-DeleteServersTestJSON-1171898101 tempest-DeleteServersTestJSON-1171898101-project-member] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1102.719503] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGHEST for action security_group_members [ 1102.719965] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.720148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.720220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.720443] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.720639] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.720748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.720814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.720972] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.721073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.721169] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.783101] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1102.783286] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 deletion is rescheduled due to dependency. [ 1102.783406] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.153840] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d in Status: SUCCESS [ 1103.154122] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d deletion is rescheduled due to dependency. [ 1103.154249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.222978] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.223165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.223232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.223456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.223551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.223753] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.223853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.223915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.224109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.224205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.224263] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be updated. [ 1103.253654] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.253813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.253851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.254191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.254420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.263587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: IN_PROGRESS for 2s [ 1104.317247] env[65469]: INFO networking_nsxv3.common.synchronization [req-c3b54966-7278-4b52-a587-fcd6fa67a583 req-42d8d706-cc1d-44c6-9903-0b0f8eb63dcf tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1104.318279] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1104.318279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.318445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.318445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.319142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.319142] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.319142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.319142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.319142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.319142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.319370] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.531420] env[65469]: INFO networking_nsxv3.common.synchronization [req-e6c332e1-973d-41bc-9680-7836e37011fe req-3384146a-8433-45c0-9b24-0e0758087ac4 tempest-ServersV294TestFqdnHostnames-1303142590 tempest-ServersV294TestFqdnHostnames-1303142590-project-member] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 1104.532049] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGHEST for action security_group_members [ 1104.532390] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.532529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.532598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.532807] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.532974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.533091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.533174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.533350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.533453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.533549] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.821599] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.036155] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.036349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.036451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.036744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.036889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.037156] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.037291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.037384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.037577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.038495] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.038495] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 is going to be updated. [ 1105.070925] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.072883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.072969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.073305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.073504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.083020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: IN_PROGRESS for 2s [ 1105.280807] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 in Status: SUCCESS [ 1105.281044] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 deletion is rescheduled due to dependency. [ 1105.281232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.324577] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.827144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.827334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.827399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.827604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.827696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.827797] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1105.860889] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.861057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.861130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.861339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.861480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.870558] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1107.000350] env[65469]: INFO networking_nsxv3.common.synchronization [req-710ce778-8b28-49dc-bde6-00f2ae792fe1 req-f8cc5a50-3266-45d3-9ddb-e8f378acd330 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1107.000642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1107.001027] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.001160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.001221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.003467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003467] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.003467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.003467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.003603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.003859] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.093474] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5be86bbb-df18-464c-9cd6-f07241444961 in Status: SUCCESS [ 1107.093619] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 deletion is rescheduled due to dependency. [ 1107.093732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.293097] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.293097] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.293097] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.293397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.293683] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.293846] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.293966] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.294211] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.294360] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.294567] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.294679] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.294785] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.294892] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.295019] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.295128] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.295260] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.313835] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.314015] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.314201] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.314386] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-461" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.314707] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-ec5835a0-5bcf-4104-93d9-96784eae5b31 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.314876] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.314996] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.315345] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.315472] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5835a0-5bcf-4104-93d9-96784eae5b31',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.506614] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.818033] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.818302] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.818429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.819030] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.819030] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.819030] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port ec5835a0-5bcf-4104-93d9-96784eae5b31 not found, creating... [ 1107.819279] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.819436] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.819551] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.819857] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.820010] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.820303] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.820462] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.820579] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.820786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.820935] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.821090] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: ec5835a0-5bcf-4104-93d9-96784eae5b31 is going to be created. [ 1107.842780] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.843013] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.843174] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.843367] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.843585] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.843811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.882111] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1107.882331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.009148] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.512338] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.512516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.512516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.512698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.512788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.513431] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1108.542833] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.542833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.542833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.542833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.542833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.555987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1108.565291] env[65469]: INFO networking_nsxv3.common.synchronization [req-710ce778-8b28-49dc-bde6-00f2ae792fe1 req-65f79dcd-d6cc-42e6-ab2e-821334ac402c service nova] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 1108.565467] env[65469]: INFO networking_nsxv3.common.synchronization [req-710ce778-8b28-49dc-bde6-00f2ae792fe1 req-65f79dcd-d6cc-42e6-ab2e-821334ac402c service nova] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1108.565602] env[65469]: INFO networking_nsxv3.common.synchronization [req-710ce778-8b28-49dc-bde6-00f2ae792fe1 req-65f79dcd-d6cc-42e6-ab2e-821334ac402c service nova] Enqueued Resource ID: ec5835a0-5bcf-4104-93d9-96784eae5b31 with Priority: HIGHEST for action port [ 1108.566931] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_rules [ 1108.567604] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1108.567604] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5835a0-5bcf-4104-93d9-96784eae5b31 with Priority: HIGHEST for action port [ 1108.567604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.567604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.567794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.567866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.568011] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.569261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.569261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.569261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec5835a0-5bcf-4104-93d9-96784eae5b31 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.569672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.569672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.569672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.569767] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5835a0-5bcf-4104-93d9-96784eae5b31',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.072226] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.072562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.072635] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec5835a0-5bcf-4104-93d9-96784eae5b31 with status ACTIVE [ 1109.073048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.073194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.073297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.073598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.073736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.073992] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.075044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.075044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.075044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.075044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.075044] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.075568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.075568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.075568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.075568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.075568] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec5835a0-5bcf-4104-93d9-96784eae5b31 is going to be updated. [ 1109.099896] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.100047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.100119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.100322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.100479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.100643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec5835a0-5bcf-4104-93d9-96784eae5b31" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.571626] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1110.572199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.572357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.572698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.572986] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.573195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.573288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.573516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.573638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.575073] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.077183] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.580174] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.082695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.082991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.083082] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.083309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.083401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.083503] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1112.111511] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.111655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.111789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.111979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.112150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.122690] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1113.567906] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.568279] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1114.137062] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1114.137665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.137665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.137746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.137880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.137995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.138068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.138781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.138781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.138781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.138781] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.640935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.739307] env[65469]: INFO networking_nsxv3.common.synchronization [None req-0c25f855-7967-4c8f-bfa4-627467dde47d tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1114.739901] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1114.740264] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.740417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.742116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.742116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.742116] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.826716] env[65469]: INFO networking_nsxv3.common.synchronization [None req-47b4b22f-7fa3-4e2c-a11b-aa4ba9dfb94c tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1114.827270] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1114.827591] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.827694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.147196] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e6975d0-2064-42d1-b410-13058e6b3c61: rpc.has_security_group_logging(os_id): False [ 1115.167397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.167397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.167534] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.167647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.167750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.168010] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.168116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.168179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.168345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.168422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.168507] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1115.227324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.227485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.227538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.227746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.227893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.245373] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1115.267848] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.267848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.267980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.268107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.268191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.268285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 already deleted. [ 1115.268408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.268574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.268765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.268810] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.789330] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.789631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.789631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.789707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.789744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.789949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 already deleted. [ 1115.790097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.928530] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.928877] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.928877] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.929172] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.929450] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.929610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.929726] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.929949] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.930895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.930895] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.931731] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.931942] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.932019] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.932138] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.932247] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.932376] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.954121] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.954368] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.954519] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.954690] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.955014] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-d8fd006e-4bb8-406a-a967-e39c6abb043a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.955197] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.955315] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.955658] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.955780] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fd006e-4bb8-406a-a967-e39c6abb043a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.259919] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1117.260158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.460231] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.460231] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.460231] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.460524] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.460590] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.460704] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port d8fd006e-4bb8-406a-a967-e39c6abb043a not found, creating... [ 1117.460978] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.461159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.461317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.461495] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.461634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.461946] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.462124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.462244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.462452] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.462585] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.462724] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: d8fd006e-4bb8-406a-a967-e39c6abb043a is going to be created. [ 1117.482543] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.482805] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.482880] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.483248] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.483537] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.483695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.188378] env[65469]: INFO networking_nsxv3.common.synchronization [req-abdf8f47-0040-46c6-9c1b-b13a88150a83 req-bf8c27c7-a565-455e-8ab1-a3cca6ea5100 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1118.188378] env[65469]: INFO networking_nsxv3.common.synchronization [req-abdf8f47-0040-46c6-9c1b-b13a88150a83 req-bf8c27c7-a565-455e-8ab1-a3cca6ea5100 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1118.188378] env[65469]: INFO networking_nsxv3.common.synchronization [req-abdf8f47-0040-46c6-9c1b-b13a88150a83 req-bf8c27c7-a565-455e-8ab1-a3cca6ea5100 service nova] Enqueued Resource ID: d8fd006e-4bb8-406a-a967-e39c6abb043a with Priority: HIGHEST for action port [ 1118.188378] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1118.189500] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1118.189627] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fd006e-4bb8-406a-a967-e39c6abb043a with Priority: HIGHEST for action port [ 1118.191266] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.191414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.191523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.192374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.192374] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.192884] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.193250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.193250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.193369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.193472] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.193565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.194018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.194018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.194018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.194018] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.194648] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fd006e-4bb8-406a-a967-e39c6abb043a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.194761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.194825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.194949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.195073] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fd006e-4bb8-406a-a967-e39c6abb043a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.697564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8fd006e-4bb8-406a-a967-e39c6abb043a with status ACTIVE [ 1118.697809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.698626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.698745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.698980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.699092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.699298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.699480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.699576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.699794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.699932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.700177] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.700317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.700401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.700650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.700805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.700925] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8fd006e-4bb8-406a-a967-e39c6abb043a is going to be updated. [ 1118.702720] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.704153] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.704153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.725822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.725977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.726045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.726251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.726393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.726546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.815275] env[65469]: INFO networking_nsxv3.common.synchronization [req-5f05a2a8-669f-48e8-bebf-0f22d036180c req-3300182d-1aae-40a4-a9ca-7c3378b8b8ad tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1118.816145] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1118.816519] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.816650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.816719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.817017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.817265] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.817434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.817552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.817739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.817835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.817935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.206411] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.233695] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.233695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.233695] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.233906] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.234093] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.234251] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.234366] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.234575] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.234718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.234919] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.235053] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.235165] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.235272] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.235389] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.235493] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.235619] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.255588] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.255767] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.255937] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.256173] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-255" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.256527] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-28ce4f02-4448-4bce-b56b-b1af438f4146 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.256712] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.256831] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.257169] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.257297] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ce4f02-4448-4bce-b56b-b1af438f4146',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.320334] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.320334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.320334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.320697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.320851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.321101] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.321297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.321356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.321531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.321634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.321744] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1119.347784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.347971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.348101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.348340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.348491] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.357418] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1119.709784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.709987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.710073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.710306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.710397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.710499] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be created. [ 1119.736476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.736651] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.736692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.736885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.737057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.746951] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: UNINITIALIZED for 2s [ 1119.760166] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.760397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.760536] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.760830] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.760974] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.761145] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 28ce4f02-4448-4bce-b56b-b1af438f4146 not found, creating... [ 1119.761406] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.761559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.761673] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.762018] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.762254] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.762570] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.762732] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.762862] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.763255] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.763422] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.763570] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 28ce4f02-4448-4bce-b56b-b1af438f4146 is going to be created. [ 1119.783198] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.783420] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.783556] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.783841] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.784084] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.784342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.563821] env[65469]: INFO networking_nsxv3.common.synchronization [req-5f05a2a8-669f-48e8-bebf-0f22d036180c req-b6109749-424e-45b7-ab11-59f5e899a03e service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1120.564106] env[65469]: INFO networking_nsxv3.common.synchronization [req-5f05a2a8-669f-48e8-bebf-0f22d036180c req-b6109749-424e-45b7-ab11-59f5e899a03e service nova] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1120.564209] env[65469]: INFO networking_nsxv3.common.synchronization [req-5f05a2a8-669f-48e8-bebf-0f22d036180c req-b6109749-424e-45b7-ab11-59f5e899a03e service nova] Enqueued Resource ID: 28ce4f02-4448-4bce-b56b-b1af438f4146 with Priority: HIGHEST for action port [ 1120.564651] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_rules [ 1120.564798] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1120.564898] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ce4f02-4448-4bce-b56b-b1af438f4146 with Priority: HIGHEST for action port [ 1120.565193] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.565317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.565383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.565578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.565650] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.566494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.566590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.566816] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-28ce4f02-4448-4bce-b56b-b1af438f4146 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.566923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.566988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.567166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.567249] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ce4f02-4448-4bce-b56b-b1af438f4146',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.833020] env[65469]: INFO networking_nsxv3.common.synchronization [req-441b0d8a-c73a-47b7-ab90-e9c6c678e6d8 req-d06cde2f-221f-4fa3-b2c8-d7c28301d3e4 tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1120.833424] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1120.833763] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.833884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.833939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.834262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.834415] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.834509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.834988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.834988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.834988] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.834988] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.069645] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.070835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.071104] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28ce4f02-4448-4bce-b56b-b1af438f4146 with status ACTIVE [ 1121.071381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.071487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.071487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.071706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.071810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.072127] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.072521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.072521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.072521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.072824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.072824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.072930] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.072973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.073195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.073325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.073438] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28ce4f02-4448-4bce-b56b-b1af438f4146 is going to be updated. [ 1121.100274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.100483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.100532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.101152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.101322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.101513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28ce4f02-4448-4bce-b56b-b1af438f4146" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.166276] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.166276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.166276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.166276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.166276] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.166276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.166572] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.166605] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.166753] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.166960] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.167662] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.167662] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.167662] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.167662] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.167662] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.167662] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.203454] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.203631] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.203773] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.203997] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.204445] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-70d36b92-9920-447f-b45d-e0cc0156c0b6 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.204445] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.204632] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.205121] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.205121] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d36b92-9920-447f-b45d-e0cc0156c0b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.339215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.339376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.339444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.339664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.339812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.340048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.340155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.340221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.340458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.340458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.340630] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e already deleted. [ 1121.340630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.369866] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1121.370285] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 deletion is rescheduled due to dependency. [ 1121.370414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.370659] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.370915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.371126] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.371326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.371326] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.371466] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.371613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.371656] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.707967] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.708375] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.708375] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.708668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.708854] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.709044] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 70d36b92-9920-447f-b45d-e0cc0156c0b6 not found, creating... [ 1121.709433] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.709645] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.709806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.710140] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.710328] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.710719] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.710946] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.711116] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.711414] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.712026] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.712026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 70d36b92-9920-447f-b45d-e0cc0156c0b6 is going to be created. [ 1121.738487] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.738727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.738853] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.739167] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.739406] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.739635] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.759070] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1121.759414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.759627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.759932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.760199] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.760347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.760434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.760656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.760779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.760890] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.761420] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.875145] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.265923] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.266164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.266270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.266674] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.266756] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.266928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.266989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.267594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.267594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.267594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.267594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.267594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.267838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.267838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.267892] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.268022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.268121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.268679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.268679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.268679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.268679] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.383208] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.427051] env[65469]: INFO networking_nsxv3.common.synchronization [req-441b0d8a-c73a-47b7-ab90-e9c6c678e6d8 req-17445ffb-1671-4b24-9fa1-fcbd93dd5f9f service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1122.427051] env[65469]: INFO networking_nsxv3.common.synchronization [req-441b0d8a-c73a-47b7-ab90-e9c6c678e6d8 req-17445ffb-1671-4b24-9fa1-fcbd93dd5f9f service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1122.427199] env[65469]: INFO networking_nsxv3.common.synchronization [req-441b0d8a-c73a-47b7-ab90-e9c6c678e6d8 req-17445ffb-1671-4b24-9fa1-fcbd93dd5f9f service nova] Enqueued Resource ID: 70d36b92-9920-447f-b45d-e0cc0156c0b6 with Priority: HIGHEST for action port [ 1122.429027] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1122.429027] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1122.430180] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d36b92-9920-447f-b45d-e0cc0156c0b6 with Priority: HIGHEST for action port [ 1122.430531] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.430646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.430746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.431670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.431670] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.432517] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.432625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.432625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.432794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.432937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.433064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.433123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.433255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.434177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.434177] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.435156] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-70d36b92-9920-447f-b45d-e0cc0156c0b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.435156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.435156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.435156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.435156] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d36b92-9920-447f-b45d-e0cc0156c0b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.771859] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6f27ff1-776e-4a70-90a6-ebc268939e44: rpc.has_security_group_logging(os_id): False [ 1122.791336] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.791549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.791549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.791790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.791900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.792108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.792207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.792269] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.792423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.792498] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.792688] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.792792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.792855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.793044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.793102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.793301] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.793394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.793456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.793600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.793673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.793757] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be created. [ 1122.866221] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.866402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.866474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.866706] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.866889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.881398] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1122.885098] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.885098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.885098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.885322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.885502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.885808] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1122.922481] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.922481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.922768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.922892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.923066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.934587] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1122.936042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.936157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.936331] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.937188] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70d36b92-9920-447f-b45d-e0cc0156c0b6 with status ACTIVE [ 1122.937616] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.937616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.937616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.937751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.937833] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.937999] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.938115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.938178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.938401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.938474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.938620] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.938778] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.938858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.939030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.939112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.939195] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70d36b92-9920-447f-b45d-e0cc0156c0b6 is going to be updated. [ 1122.986855] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.987129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.987248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.987468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.987718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.987922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70d36b92-9920-447f-b45d-e0cc0156c0b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.219059] env[65469]: INFO networking_nsxv3.common.synchronization [req-1a7241dd-6fd0-4e6c-8b2a-91c2f0a92764 req-257fc241-5fb1-461b-851d-b1113f14b671 tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1123.219484] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1123.219815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.219984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.441834] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.577594] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.577826] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.577937] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.578743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.578743] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.578743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.578743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.578982] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.579047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.579252] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.579365] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.579475] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.579581] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.579690] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.579867] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.580042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.598636] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.598812] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.599958] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.599958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.599958] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.599958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.599958] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.600824] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.601463] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba0c3b2-f18a-401a-82ec-378215ec1e9f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.943508] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.943969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.943969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.943969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.944132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.944132] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be created. [ 1123.968123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.968325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.968325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.968546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.968705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.979442] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: UNINITIALIZED for 2s [ 1124.103862] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.104129] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.104236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.104509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.104662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.104812] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 3ba0c3b2-f18a-401a-82ec-378215ec1e9f not found, creating... [ 1124.105067] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.105225] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.105340] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.105649] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.105860] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.106399] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.106634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.106790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.107130] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.107806] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.107806] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 3ba0c3b2-f18a-401a-82ec-378215ec1e9f is going to be created. [ 1124.132281] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.132670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.132670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.132888] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.133306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.133634] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.584496] env[65469]: INFO networking_nsxv3.common.synchronization [req-dc1ce46f-ffd4-49e2-ae30-26ec1f9738e3 req-ff05b0de-75a9-4e7b-8e06-259083811a1c tempest-ServersTestJSON-1262727836 tempest-ServersTestJSON-1262727836-project-member] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1124.585051] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGHEST for action security_group_members [ 1124.585367] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.585489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.585551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.585746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.585896] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.585994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.586120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.586213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.586294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.586400] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.836517] env[65469]: INFO networking_nsxv3.common.synchronization [req-1a7241dd-6fd0-4e6c-8b2a-91c2f0a92764 req-ad922fd2-6c44-471a-97c6-fab5b2592099 service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1124.836774] env[65469]: INFO networking_nsxv3.common.synchronization [req-1a7241dd-6fd0-4e6c-8b2a-91c2f0a92764 req-ad922fd2-6c44-471a-97c6-fab5b2592099 service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1124.836818] env[65469]: INFO networking_nsxv3.common.synchronization [req-1a7241dd-6fd0-4e6c-8b2a-91c2f0a92764 req-ad922fd2-6c44-471a-97c6-fab5b2592099 service nova] Enqueued Resource ID: 3ba0c3b2-f18a-401a-82ec-378215ec1e9f with Priority: HIGHEST for action port [ 1124.837389] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1124.837520] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1124.837614] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba0c3b2-f18a-401a-82ec-378215ec1e9f with Priority: HIGHEST for action port [ 1124.837887] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.838009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.838676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.838827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.838956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.839067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.839159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.841034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.841034] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba0c3b2-f18a-401a-82ec-378215ec1e9f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.896285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1124.896446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.943120] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1124.943370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.943541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.943804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.943997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.944128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.944227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.944410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.944488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.944572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.944660] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.088028] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.088201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.088263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.088520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.088641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.088863] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.088974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.089093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.089224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.089302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.089388] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be updated. [ 1125.117354] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.117519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.117589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.117822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.117979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.128601] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: IN_PROGRESS for 2s [ 1125.341856] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ba0c3b2-f18a-401a-82ec-378215ec1e9f with status ACTIVE [ 1125.341856] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.342136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.342172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.342412] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.342516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.342730] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.342838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.342906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.343102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.343182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.343378] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.343474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.343570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.343703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.343776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.343862] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ba0c3b2-f18a-401a-82ec-378215ec1e9f is going to be updated. [ 1125.374420] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.374755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.374912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.375154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.375364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.375558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba0c3b2-f18a-401a-82ec-378215ec1e9f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.446629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.446819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.446883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.447168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.447379] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.447493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.447560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.447753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.447839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.447932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.448242] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.448242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.448364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.448434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.448594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.448701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.448790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.448980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.449077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.449158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.449262] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.624110] env[65469]: INFO networking_nsxv3.common.synchronization [req-35733657-c82b-4658-814a-b9f429436eeb req-74608532-edc7-4b12-ac06-ac062e459f48 tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1125.624773] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1125.625107] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.625453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.953357] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd6b3522-babc-4977-91f4-6a81f2f59e88: rpc.has_security_group_logging(os_id): False [ 1125.963928] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.964143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.964293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.964570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.964825] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.965008] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.965099] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.965340] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.965451] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.965656] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.965767] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.965878] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.965975] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.966100] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.966207] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.966334] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.972012] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.972126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.972177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.972359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.972447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.972661] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.972758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.972821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.973011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.973092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.973269] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.973362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.973422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.973556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.973628] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.973798] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.973897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.973957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.974110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.974185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.974266] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1125.985349] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.985461] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.985601] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.985770] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-939" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.986094] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-f4449945-8530-4ab4-bdab-575b3970f331 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.986263] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.986381] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.986709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.986846] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4449945-8530-4ab4-bdab-575b3970f331',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.997201] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1125.997423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.997586] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.997797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.997979] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.998108] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.998174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.998315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.998393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.998475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.998569] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.999558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.999558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.000541] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.000541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.000541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.000829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.000938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.001021] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.046744] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.046903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.046989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.047296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.047445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.066328] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1126.491066] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.491324] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.491455] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.491741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.491896] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.492139] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port f4449945-8530-4ab4-bdab-575b3970f331 not found, creating... [ 1126.492402] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.492559] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.492675] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.492947] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.493248] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.493545] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.493707] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.493829] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.494065] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.494247] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.494359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: f4449945-8530-4ab4-bdab-575b3970f331 is going to be created. [ 1126.504133] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.504292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.504427] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.514117] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.514342] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.514472] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.514734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.514983] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.515265] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.007312] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.138322] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 709a1070-5186-40a8-ad7e-f0a18412647f in Status: SUCCESS [ 1127.138508] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f deletion is rescheduled due to dependency. [ 1127.138665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.509735] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.509900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.509978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.510197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.510296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.510405] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1127.542370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.542526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.542599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.542824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.542982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.551874] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1127.692700] env[65469]: INFO networking_nsxv3.common.synchronization [req-35733657-c82b-4658-814a-b9f429436eeb req-d89e4580-1ef1-4bd5-adab-1e3528f80138 service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1127.692855] env[65469]: INFO networking_nsxv3.common.synchronization [req-35733657-c82b-4658-814a-b9f429436eeb req-d89e4580-1ef1-4bd5-adab-1e3528f80138 service nova] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1127.693024] env[65469]: INFO networking_nsxv3.common.synchronization [req-35733657-c82b-4658-814a-b9f429436eeb req-d89e4580-1ef1-4bd5-adab-1e3528f80138 service nova] Enqueued Resource ID: f4449945-8530-4ab4-bdab-575b3970f331 with Priority: HIGHEST for action port [ 1127.693589] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_rules [ 1127.693916] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1127.693916] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4449945-8530-4ab4-bdab-575b3970f331 with Priority: HIGHEST for action port [ 1127.694149] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.694252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.694410] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.694492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.694673] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4449945-8530-4ab4-bdab-575b3970f331 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.694770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.694832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.695052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.695136] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4449945-8530-4ab4-bdab-575b3970f331',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.058081] env[65469]: INFO networking_nsxv3.common.synchronization [req-9927ac63-3117-4424-bbd1-9084dba93832 req-e4341933-0db6-45b9-ba65-ea254623e300 tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1128.058754] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1128.059161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.059297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.059374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.059645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.059838] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.060067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.060067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.060253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.060329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.060766] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.084883] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1128.085245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.198547] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4449945-8530-4ab4-bdab-575b3970f331 with status ACTIVE [ 1128.198939] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.199186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.199322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.199643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.199799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.200165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.200299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.200299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.200454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.200561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.200753] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.201171] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.201243] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.201400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.201474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.201566] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4449945-8530-4ab4-bdab-575b3970f331 is going to be updated. [ 1128.239353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.239557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.239767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.240075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.240264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.240477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4449945-8530-4ab4-bdab-575b3970f331" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.471595] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.471595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.471595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.471808] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.471993] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.472298] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.472419] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.472642] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.472786] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.473017] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.473168] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.473239] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.473345] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.473450] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.473552] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.473681] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.494943] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.495222] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.495418] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.495662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.496126] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-0f1f1947-25b7-44a7-ad7d-de796c091c4c taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.496399] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.496576] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.497124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.497366] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1f1947-25b7-44a7-ad7d-de796c091c4c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.563524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.563691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.563744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.563958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.564055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.564249] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.564348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.564405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.564554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.564619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.564701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 already deleted. [ 1128.564777] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.000951] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.000951] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.000951] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.001195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.001195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.001302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 0f1f1947-25b7-44a7-ad7d-de796c091c4c not found, creating... [ 1129.001573] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.001771] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.001850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.002154] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.002316] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.002677] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.002891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.003041] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.003317] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.003497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.003647] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 0f1f1947-25b7-44a7-ad7d-de796c091c4c is going to be created. [ 1129.024028] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.024305] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.024461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.024782] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.025090] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.025385] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.566191] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1129.566507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.566774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.567092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.567311] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.567436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.567505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.567673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.567790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.567844] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.742749] env[65469]: INFO networking_nsxv3.common.synchronization [req-9927ac63-3117-4424-bbd1-9084dba93832 req-6f67e7db-5dc8-48e9-8c4a-e67023aee377 service nova] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1129.742956] env[65469]: INFO networking_nsxv3.common.synchronization [req-9927ac63-3117-4424-bbd1-9084dba93832 req-6f67e7db-5dc8-48e9-8c4a-e67023aee377 service nova] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1129.743149] env[65469]: INFO networking_nsxv3.common.synchronization [req-9927ac63-3117-4424-bbd1-9084dba93832 req-6f67e7db-5dc8-48e9-8c4a-e67023aee377 service nova] Enqueued Resource ID: 0f1f1947-25b7-44a7-ad7d-de796c091c4c with Priority: HIGHEST for action port [ 1129.743752] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_rules [ 1129.743838] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1129.743910] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1f1947-25b7-44a7-ad7d-de796c091c4c with Priority: HIGHEST for action port [ 1129.744312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.745289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.745289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.745289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.745289] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.745657] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.745801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.745886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.746100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.746276] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.746408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.747118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.747118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.747118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.747118] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.748264] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f1f1947-25b7-44a7-ad7d-de796c091c4c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.748264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.748264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.748508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.748508] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1f1947-25b7-44a7-ad7d-de796c091c4c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.071366] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.250322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.250540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.250585] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.251811] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f1f1947-25b7-44a7-ad7d-de796c091c4c with status ACTIVE [ 1130.251811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.252061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.252061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.252156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.252251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.252463] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.252533] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.252570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.252886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.252886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.252971] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.253081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.253172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.253282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.253355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.253441] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f1f1947-25b7-44a7-ad7d-de796c091c4c is going to be updated. [ 1130.276342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.276505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.276505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.276713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.276857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.277094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f1f1947-25b7-44a7-ad7d-de796c091c4c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.574902] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.756487] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.078766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.078766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.078766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.078766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.078766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.078766] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1131.111165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.111165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.111165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.111801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.115761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.125806] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1131.260487] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.260487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.260487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.260753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.260887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.260936] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 is going to be created. [ 1131.298306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.298592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.298592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.298936] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.299131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.311543] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: UNINITIALIZED for 2s [ 1132.285137] env[65469]: INFO networking_nsxv3.common.synchronization [req-2d45747d-87f1-4b8d-b479-463b2628975f req-af0052e4-f906-4045-a14a-69f695db5d96 tempest-ImagesOneServerNegativeTestJSON-1496561822 tempest-ImagesOneServerNegativeTestJSON-1496561822-project-member] Enqueued Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1132.285137] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 with Priority: HIGHEST for action security_group_members [ 1132.285137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6b3522-babc-4977-91f4-6a81f2f59e88 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.285137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.285137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.285137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.286480] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.286480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.286480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.286480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.286480] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.286480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6b3522-babc-4977-91f4-6a81f2f59e88',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.791518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.791684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.791771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.792130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.792209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.792521] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.792629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.792713] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.792882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.792977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.793099] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 is going to be updated. [ 1132.830730] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.830730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.830730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.831069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.831069] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.844537] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: IN_PROGRESS for 2s [ 1133.137766] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1133.138027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.138237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.138464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.138652] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.138770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.138836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.138990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.139115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.139228] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.324072] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: SUCCESS [ 1133.324072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.324072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.324609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.324609] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.324609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.324776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.324917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.325021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.325145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.325275] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.641312] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.827905] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.034779] env[65469]: INFO networking_nsxv3.common.synchronization [None req-29f4f5da-cf78-4f84-89fc-6a91962c421c tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1134.035331] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1134.035761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.035894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.035923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.036261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.036261] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.122323] env[65469]: INFO networking_nsxv3.common.synchronization [None req-886cc36e-e3af-41a8-a0d0-87d27c6dcff7 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1134.122849] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1134.123215] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.123337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.144332] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.333300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65758665-de1b-4948-a04f-b4dbcf296be9: rpc.has_security_group_logging(os_id): False [ 1134.357517] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.357692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.357811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.358233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.358410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.358769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.358961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.359096] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.359439] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.359545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.359713] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 is going to be created. [ 1134.437344] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.437344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.437800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.437800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.437944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.451332] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: IN_PROGRESS for 2s [ 1134.561147] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.561351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.561394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.561645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.561741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.562467] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 already deleted. [ 1134.562467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.562467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.562969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.563157] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.647324] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.647528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.647614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.647817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.647907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.648027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1134.682551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.682745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.682814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.683730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.683903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.693219] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1134.854026] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 in Status: SUCCESS [ 1134.854026] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6b3522-babc-4977-91f4-6a81f2f59e88 deletion is rescheduled due to dependency. [ 1134.854026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6b3522-babc-4977-91f4-6a81f2f59e88" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.912946] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.913209] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.913350] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.913614] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.913863] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.914032] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.914148] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.914420] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.914589] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.914798] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.914911] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.915031] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.915138] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.915246] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.915347] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.915477] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.934345] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.934345] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1134.934345] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.934345] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-938" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.934345] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-d8fd006e-4bb8-406a-a967-e39c6abb043a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.934345] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.934708] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.934708] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.934770] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fd006e-4bb8-406a-a967-e39c6abb043a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.083805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.084103] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.084231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.084473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.084634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.084769] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 already deleted. [ 1135.084888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.437114] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.437534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.437589] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.437882] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.438064] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.438431] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.438606] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.438740] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.438989] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.439157] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.439560] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.439713] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.439795] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.440050] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.440477] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.440703] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: d8fd006e-4bb8-406a-a967-e39c6abb043a is going to be updated. [ 1135.466439] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.466669] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.466878] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.467208] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.467414] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.467636] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.157061] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0a284d8-1074-4cf2-959b-32132ca33179 req-8c47c287-5330-44aa-9852-0c0b381efe50 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1136.157061] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0a284d8-1074-4cf2-959b-32132ca33179 req-8c47c287-5330-44aa-9852-0c0b381efe50 service nova] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1136.157061] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0a284d8-1074-4cf2-959b-32132ca33179 req-8c47c287-5330-44aa-9852-0c0b381efe50 service nova] Enqueued Resource ID: d8fd006e-4bb8-406a-a967-e39c6abb043a with Priority: HIGHEST for action port [ 1136.157061] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_rules [ 1136.157438] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1136.157438] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fd006e-4bb8-406a-a967-e39c6abb043a with Priority: HIGHEST for action port [ 1136.157643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.157762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.157819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.158027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.158102] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.159835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.159985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.160050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.160250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.160430] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.160562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.160615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.160773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.160854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.161210] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.162283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fd006e-4bb8-406a-a967-e39c6abb043a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.162514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.162596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.162858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.162942] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fd006e-4bb8-406a-a967-e39c6abb043a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.464077] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: SUCCESS [ 1136.464349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.660532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.660670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.663372] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.665144] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8fd006e-4bb8-406a-a967-e39c6abb043a with status ACTIVE [ 1136.665352] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.665479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.666212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.666212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.666212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.666212] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.666212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.666212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.666463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.666463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.666639] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.666639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.666731] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.666804] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.666876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.666959] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8fd006e-4bb8-406a-a967-e39c6abb043a is going to be updated. [ 1136.692123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.692315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.692361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.692602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.692767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.692953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fd006e-4bb8-406a-a967-e39c6abb043a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.703097] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1136.703260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.703422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.704636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.704636] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.704636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.705123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.705123] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.705123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.705123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.705123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.705272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.705272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.705348] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.706150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.706311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.706457] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.706551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.706614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.706747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.706820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.706903] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.165609] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.208606] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858870d8-a7bb-4e33-8a8a-f46123eb652e: rpc.has_security_group_logging(os_id): False [ 1137.209987] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.237761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.237955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.237955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.238266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.238312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.238540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.238672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.238738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.238942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.239035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.239497] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.239574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.239639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.239790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.239854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.240093] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.240179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.240247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.240391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.240463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.240546] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be created. [ 1137.307615] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.307852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.307852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.308067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.308254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.325712] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1137.668676] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.668974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.668974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.669224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.669343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.669452] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1137.700873] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.701064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.701174] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.701402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.701556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.711672] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1137.714103] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.218333] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.218333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.218333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.218333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.218333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.218333] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1138.256203] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.256354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.256430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.257179] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.257620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.268289] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1139.340483] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1139.341215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.341215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.341215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.341215] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.723361] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1139.723598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.723769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.723998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.724263] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.724365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.724365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.724518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.724629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.724677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.724766] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.844011] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.844221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.229122] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.229302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.229358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.229576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.229750] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.229832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.229893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.230099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.230199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.230288] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.230440] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.230577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.230577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.230718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.230849] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.230937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.230997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.231146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.231220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.231297] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.231386] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.277839] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1140.278169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.278390] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.278678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.278928] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.279113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.279205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.279434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.279544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.279666] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.279795] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.734060] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6f27ff1-776e-4a70-90a6-ebc268939e44: rpc.has_security_group_logging(os_id): False [ 1140.752493] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.752682] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.752758] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.752989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.753098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.753306] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.753405] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.753467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.753612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.753684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.753880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.753973] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.754051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.754193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.754265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.754549] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.754649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.754709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.754849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.754923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.755011] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1140.782470] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.782630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.782741] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.783115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.783372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.783497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.783565] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.783750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.783853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.783954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.784136] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.784287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.784367] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.784521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.784697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.784817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.784912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.785144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.785236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.785314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.785412] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.837482] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.837688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.837726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.837974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.838206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.859132] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1141.159260] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1141.159351] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1141.287459] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858870d8-a7bb-4e33-8a8a-f46123eb652e: rpc.has_security_group_logging(os_id): False [ 1141.315899] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.316683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.316881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.317152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.317286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.317824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.318012] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.318109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.318388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.318786] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.319056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.319267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.319330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.319487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.319591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.319878] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.320377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.320479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.320609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.320687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.320775] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1141.386280] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.386486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.386486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.386722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.386868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.401168] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1141.645428] env[65469]: INFO networking_nsxv3.common.synchronization [req-385cee36-9e45-4889-b7fd-5858962d59e7 req-f9345e7c-4e0d-48f7-8936-2aa275bacbef tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1141.649016] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1141.649016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.649016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.649016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.649016] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.064339] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.064648] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.064734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.065017] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.065279] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.065439] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.065668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.065946] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.066184] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.066452] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.066650] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.066893] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.067125] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.067324] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.067505] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.067693] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.088035] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.088300] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.088496] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.088816] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.089222] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-951956cf-25c7-49a8-ada9-d0206c706f83 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.089535] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.089743] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.090132] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.090930] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('951956cf-25c7-49a8-ada9-d0206c706f83',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.151437] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.151663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.151779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.152229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.152428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.152726] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.152904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.152981] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.153177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.153295] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.153408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 already deleted. [ 1142.153555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.594446] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.594684] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.594811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.595112] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.595270] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.595450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 951956cf-25c7-49a8-ada9-d0206c706f83 not found, creating... [ 1142.595718] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.595877] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.595995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.596234] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.596374] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.596647] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.596800] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.596943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.597280] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.597423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.597690] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 951956cf-25c7-49a8-ada9-d0206c706f83 is going to be created. [ 1142.621301] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.622706] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.622706] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.622706] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.622706] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.622706] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.877320] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1142.877654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.417787] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1143.418145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.418410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.418625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.418770] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.462259] env[65469]: INFO networking_nsxv3.common.synchronization [req-385cee36-9e45-4889-b7fd-5858962d59e7 req-21b21c70-d8c3-4868-8f92-a7306bc8afca service nova] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1143.462259] env[65469]: INFO networking_nsxv3.common.synchronization [req-385cee36-9e45-4889-b7fd-5858962d59e7 req-21b21c70-d8c3-4868-8f92-a7306bc8afca service nova] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1143.462372] env[65469]: INFO networking_nsxv3.common.synchronization [req-385cee36-9e45-4889-b7fd-5858962d59e7 req-21b21c70-d8c3-4868-8f92-a7306bc8afca service nova] Enqueued Resource ID: 951956cf-25c7-49a8-ada9-d0206c706f83 with Priority: HIGHEST for action port [ 1143.466026] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_rules [ 1143.466026] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1143.466026] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 951956cf-25c7-49a8-ada9-d0206c706f83 with Priority: HIGHEST for action port [ 1143.466026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.466026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.466026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.466026] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.466026] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.466026] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.466554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.466554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.466554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.466554] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.466742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.466860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.466987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.467115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.467235] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.469279] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-951956cf-25c7-49a8-ada9-d0206c706f83 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.469357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.469658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.469658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.469782] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('951956cf-25c7-49a8-ada9-d0206c706f83',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.922201] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.922567] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.922668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.924038] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.924286] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.924448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.924522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.924716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.924835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.924984] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.924984] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.971961] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.974042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.974042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.974042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 951956cf-25c7-49a8-ada9-d0206c706f83 with status ACTIVE [ 1143.974042] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.974042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.974376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.974425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.975236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.975236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.975236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.975236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.977168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.977168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.977168] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 951956cf-25c7-49a8-ada9-d0206c706f83 is going to be updated. [ 1144.005091] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.005091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.005091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.005091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.005091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.005091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-951956cf-25c7-49a8-ada9-d0206c706f83" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.428918] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.429284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.429284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.429494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.429689] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.429797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.429889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.430105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.430197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.430264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.430451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.430521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.430590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.430734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.430890] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.430983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.431073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.431221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.431296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.431385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.431485] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.478208] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.935033] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858870d8-a7bb-4e33-8a8a-f46123eb652e: rpc.has_security_group_logging(os_id): False [ 1144.954901] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.955063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.955136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.955346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.955433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.955650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.955746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.955808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.955964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.956049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.956221] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.956315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.956377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.956518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.956584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.956752] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.956843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.956903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.957046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.957121] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.957204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1144.981262] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.981537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.981537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.981756] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.981851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.981956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 is going to be created. [ 1145.011724] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.011932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.012396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.012396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.012490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.024817] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: UNINITIALIZED for 2s [ 1145.027448] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.027902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.027902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.028021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.028207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.040998] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1146.343154] env[65469]: INFO networking_nsxv3.common.synchronization [req-d0bcc4e7-19cb-4086-8995-937ec7a67c83 req-89440fc0-f7a4-4597-a608-9c2e7381ce3c tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1146.344181] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1146.344256] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.344361] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.344465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.344650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.344811] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.344929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.345025] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.345169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.345290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.345401] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.849196] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.849330] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.849382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.849594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.849687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.850087] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.850087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.850087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.850279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.850313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.850406] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1146.880395] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.880549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.880626] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.880879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.881050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.890584] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1147.037285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: SUCCESS [ 1147.037399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.039089] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.039089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.039089] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.058403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1147.058403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.540812] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.043710] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c63cff5-58e6-4b63-8e2b-267cac3740b5: rpc.has_security_group_logging(os_id): False [ 1148.084202] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.084355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.084394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.084640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.084734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.084997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.085115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.085189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.085342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.085417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.085519] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 is going to be created. [ 1148.177055] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.177055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.177055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.177055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.177055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.199274] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: IN_PROGRESS for 2s [ 1148.899981] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1148.900417] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a deletion is rescheduled due to dependency. [ 1148.900417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.214226] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: SUCCESS [ 1150.214568] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.344426] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1151.344807] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1151.574480] env[65469]: INFO networking_nsxv3.common.synchronization [req-0264faab-9107-4618-9164-b64f17578110 req-55fbf28d-5ccf-4af5-b587-8c047b8697ee tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1151.575108] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1151.576063] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.576063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.576063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.576063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.576063] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.576365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.576365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.576477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.577867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.577867] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.079480] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.582442] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.085030] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.085161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.085299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.085544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.085642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.085878] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be updated. [ 1153.135016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.135254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.135254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.135458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.135604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.148455] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1154.477198] env[65469]: INFO networking_nsxv3.common.synchronization [req-c0041022-dea3-4981-a404-be5773ee8e68 req-b0c31108-314d-4200-a069-c6030de8a8df tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1154.477742] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1154.477851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.478046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.478106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.478325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.478600] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.478600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.479650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.479650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.479650] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.479650] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.981429] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.161210] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1155.161417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.484642] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.987437] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.987662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.987662] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.987910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.988020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.988123] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1156.033573] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.033831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.033831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.033994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.034189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.046843] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1157.198954] env[65469]: INFO networking_nsxv3.common.synchronization [req-02a74d69-9efa-4bfc-8ca7-8dc88f754d46 req-1e9f3fae-3bfa-48c5-a701-9cb8462ca147 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1157.200351] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1157.200690] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.200826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.200897] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.201135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.201295] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.201413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.201484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.201744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.201911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.202067] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.704592] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.704989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.705144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.705355] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.705450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.705682] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.705815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.705888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.706013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.706099] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.706183] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1157.731608] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.731870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.731870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.732044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.732238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.740912] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1157.973323] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.973590] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.973751] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.974101] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.974376] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.974538] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.974653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.974875] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.975028] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.975234] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.975345] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.975453] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.975558] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.975711] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.975793] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.975898] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.997561] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.997785] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.997972] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.998223] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.998567] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-d31c4e90-c12e-4045-a72a-94e0a4b906c5 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.998712] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.998881] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.999225] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.999364] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d31c4e90-c12e-4045-a72a-94e0a4b906c5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.057895] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1158.058145] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.502480] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.502884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.502884] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.502975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.503139] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.503295] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port d31c4e90-c12e-4045-a72a-94e0a4b906c5 not found, creating... [ 1158.503632] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.503821] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.503939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.504174] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.504313] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.504624] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.504789] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.505019] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.505167] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.506095] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.506095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: d31c4e90-c12e-4045-a72a-94e0a4b906c5 is going to be created. [ 1158.526154] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.526399] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.526489] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.526765] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.526995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.527236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.230559] env[65469]: INFO networking_nsxv3.common.synchronization [req-02a74d69-9efa-4bfc-8ca7-8dc88f754d46 req-72fd979b-b22d-4f56-810b-7e98f44cdeaf service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1159.230755] env[65469]: INFO networking_nsxv3.common.synchronization [req-02a74d69-9efa-4bfc-8ca7-8dc88f754d46 req-72fd979b-b22d-4f56-810b-7e98f44cdeaf service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1159.230894] env[65469]: INFO networking_nsxv3.common.synchronization [req-02a74d69-9efa-4bfc-8ca7-8dc88f754d46 req-72fd979b-b22d-4f56-810b-7e98f44cdeaf service nova] Enqueued Resource ID: d31c4e90-c12e-4045-a72a-94e0a4b906c5 with Priority: HIGHEST for action port [ 1159.231435] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1159.231570] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1159.231667] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c4e90-c12e-4045-a72a-94e0a4b906c5 with Priority: HIGHEST for action port [ 1159.232051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.232188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.232333] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.232528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.232610] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.233664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.233664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.233832] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d31c4e90-c12e-4045-a72a-94e0a4b906c5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.233885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.233918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.234098] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.234168] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d31c4e90-c12e-4045-a72a-94e0a4b906c5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.735650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.735954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.736344] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d31c4e90-c12e-4045-a72a-94e0a4b906c5 with status ACTIVE [ 1159.736385] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.736525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.736658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.736949] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.737060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.737283] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.737414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.737487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.737710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.737832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.738054] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.738191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.738277] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.738630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.738744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.738877] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d31c4e90-c12e-4045-a72a-94e0a4b906c5 is going to be updated. [ 1159.752686] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1159.752867] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a deletion is rescheduled due to dependency. [ 1159.752979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.753436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.753436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.753567] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.753648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.753709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.753865] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.753956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.754108] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.764124] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.764289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.764374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.764606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.764750] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.764903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d31c4e90-c12e-4045-a72a-94e0a4b906c5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.257659] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.762563] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.265401] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.265619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.265663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.265903] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.265998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.266137] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1161.293874] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.294097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.294097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.294287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.294411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.303095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1162.228232] env[65469]: INFO networking_nsxv3.common.synchronization [req-491e94b6-ccd3-4db2-b940-654a5028be7f req-59c32106-82d2-4f52-ad7b-2425ef36201e tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1162.228232] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGHEST for action security_group_members [ 1162.228232] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.228510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.228510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.228570] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.228711] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.228815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.229077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.229077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.229170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.229198] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.733125] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.733388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.733470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.734242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.734242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.734242] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.734242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.734242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.735420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.735420] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.735420] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be updated. [ 1162.761280] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.761442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.761494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.761688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.761827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.779259] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: IN_PROGRESS for 2s [ 1163.315553] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1163.316447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.316646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.316884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.317118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.317244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.317325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.317477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.317581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.317641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.317743] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.820502] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.323331] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 1164.343349] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.343558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.343601] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.343848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.343961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.344263] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.344370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.344445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.344646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.344727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.344845] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1164.396083] env[65469]: INFO networking_nsxv3.common.synchronization [req-f71bdf7a-11af-4b37-a498-f048c53e1d2d req-ff508328-4b22-49c4-8a7d-aa5718008683 tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1164.396083] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1164.396723] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.396723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.396723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.396895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.397237] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.397354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.398241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.398241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.398241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.398241] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.410579] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.410757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.410830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.412638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.412638] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.430020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1164.790661] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 in Status: SUCCESS [ 1164.790880] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 deletion is rescheduled due to dependency. [ 1164.791013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.900844] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.402852] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.906088] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.906281] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.906327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.906554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.906649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.906766] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1165.963171] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.963403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.963403] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.963634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.963794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.978876] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1166.446194] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1166.447354] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.806367] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c4a56d6f-8bcd-47c5-b9d6-6dd0ee9fb2f4 tempest-AttachInterfacesTestJSON-766790118 tempest-AttachInterfacesTestJSON-766790118-project-member] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1167.806947] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGHEST for action security_group_members [ 1167.807639] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.807776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.807842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.808050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.808202] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.808309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.808364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.808522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.808609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.808701] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.987623] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1167.987841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.311518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.311518] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.311518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.311857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.311857] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be updated. [ 1168.340889] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.341088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.341140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.341339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.341482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.350967] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: IN_PROGRESS for 2s [ 1168.875343] env[65469]: INFO networking_nsxv3.common.synchronization [None req-61000ac7-56a6-4e63-a9c8-74028cd594be None None] Enqueued Resource ID: 3949be46-22c7-42db-8802-52f7142d6eb6 with Priority: HIGHEST for action port [ 1168.875848] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3949be46-22c7-42db-8802-52f7142d6eb6 with Priority: HIGHEST for action port [ 1168.876273] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-3949be46-22c7-42db-8802-52f7142d6eb6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.876273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3949be46-22c7-42db-8802-52f7142d6eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.876452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3949be46-22c7-42db-8802-52f7142d6eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.876800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3949be46-22c7-42db-8802-52f7142d6eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.876800] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3949be46-22c7-42db-8802-52f7142d6eb6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.315633] env[65469]: INFO networking_nsxv3.common.synchronization [None req-3a3c2839-c9f8-4f8c-92ae-f6af06682a2c tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1169.315633] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1169.315633] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.315633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.315633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.315915] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.316119] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.380583] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3949be46-22c7-42db-8802-52f7142d6eb6 [ 1169.382878] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.382878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.382878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.382878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.382878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.382878] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3949be46-22c7-42db-8802-52f7142d6eb6 already deleted. [ 1169.382878] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3949be46-22c7-42db-8802-52f7142d6eb6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.414736] env[65469]: INFO networking_nsxv3.common.synchronization [None req-6a083a4c-9dd2-4319-a500-859c330825ec tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1169.414736] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1169.414736] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.414736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.839397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.839397] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 already deleted. [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.839397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.839397] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.360372] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.360734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.360734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.360831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.360875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.360954] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 already deleted. [ 1170.361146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.362733] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 in Status: SUCCESS [ 1170.362733] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 deletion is rescheduled due to dependency. [ 1170.362812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.605782] env[65469]: INFO networking_nsxv3.common.synchronization [None req-607ca636-2725-4385-9981-bd9619ed338b None None] Enqueued Resource ID: d0dbe111-58ab-4221-84dd-57095de72c1c with Priority: HIGHEST for action port [ 1171.606331] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dbe111-58ab-4221-84dd-57095de72c1c with Priority: HIGHEST for action port [ 1171.606630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0dbe111-58ab-4221-84dd-57095de72c1c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.606753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0dbe111-58ab-4221-84dd-57095de72c1c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.606809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0dbe111-58ab-4221-84dd-57095de72c1c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0dbe111-58ab-4221-84dd-57095de72c1c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607218] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0dbe111-58ab-4221-84dd-57095de72c1c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.108836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0dbe111-58ab-4221-84dd-57095de72c1c [ 1172.109104] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.109242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.109311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.109535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.109627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.109718] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0dbe111-58ab-4221-84dd-57095de72c1c already deleted. [ 1172.109797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0dbe111-58ab-4221-84dd-57095de72c1c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.488918] env[65469]: INFO networking_nsxv3.common.synchronization [None req-819e8da0-1dd6-4350-8e35-ad044d674175 None None] Enqueued Resource ID: 34ab31e5-9953-4b32-bc3a-01853c463bca with Priority: HIGHEST for action port [ 1172.489444] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ab31e5-9953-4b32-bc3a-01853c463bca with Priority: HIGHEST for action port [ 1172.489818] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ab31e5-9953-4b32-bc3a-01853c463bca taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.489914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ab31e5-9953-4b32-bc3a-01853c463bca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.489953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ab31e5-9953-4b32-bc3a-01853c463bca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.490196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ab31e5-9953-4b32-bc3a-01853c463bca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.490286] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ab31e5-9953-4b32-bc3a-01853c463bca',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.602199] env[65469]: INFO networking_nsxv3.common.synchronization [req-551accde-2824-4dcc-abda-6c02d03f81f9 req-699fe879-d270-47b2-a8d0-3e12bfbeaff2 tempest-ListServerFiltersTestJSON-768653812 tempest-ListServerFiltersTestJSON-768653812-project-member] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1172.605451] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGHEST for action security_group_members [ 1172.605451] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.605451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.605873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.607705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.607705] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.607705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.607705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.607705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.607705] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.607705] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.992286] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34ab31e5-9953-4b32-bc3a-01853c463bca [ 1172.992598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.992739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.992808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.993044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.993201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.993250] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34ab31e5-9953-4b32-bc3a-01853c463bca already deleted. [ 1172.993310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ab31e5-9953-4b32-bc3a-01853c463bca" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.109642] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.109882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.109986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.110264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.110723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.110933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.111089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.111164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.111344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.111423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.111621] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be updated. [ 1173.165553] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.165694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.165805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.166191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.166364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.177105] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: IN_PROGRESS for 2s [ 1173.281271] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ea843bf7-38a0-432f-9030-b1eaf2b473f4 tempest-ServersTestBootFromVolume-804646923 tempest-ServersTestBootFromVolume-804646923-project-member] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1173.281985] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1173.282410] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.282542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.282633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.282853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.282935] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.402986] env[65469]: INFO networking_nsxv3.common.synchronization [None req-c0c58601-e7f5-4390-a64f-9f8303d2fec8 tempest-ServersTestBootFromVolume-804646923 tempest-ServersTestBootFromVolume-804646923-project-member] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1173.402986] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1173.402986] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.402986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.804643] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.804975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.804975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.805076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.805105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.805206] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 already deleted. [ 1173.805284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.805691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.805691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.805691] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.329872] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.330160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.330284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.330545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.330690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.330829] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 already deleted. [ 1174.330954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.854737] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d9e91e11-0ff4-4dad-a6ba-c6386045ca0b None None] Enqueued Resource ID: abb4b186-60fc-49d0-969b-c0ff0643c8b6 with Priority: HIGHEST for action port [ 1174.855173] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb4b186-60fc-49d0-969b-c0ff0643c8b6 with Priority: HIGHEST for action port [ 1174.855483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb4b186-60fc-49d0-969b-c0ff0643c8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.855604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb4b186-60fc-49d0-969b-c0ff0643c8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.855671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb4b186-60fc-49d0-969b-c0ff0643c8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.855910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb4b186-60fc-49d0-969b-c0ff0643c8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.855991] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb4b186-60fc-49d0-969b-c0ff0643c8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.187137] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e in Status: SUCCESS [ 1175.187370] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e deletion is rescheduled due to dependency. [ 1175.187551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.300519] env[65469]: INFO networking_nsxv3.common.synchronization [req-35f32c81-85f9-45ec-8967-00fd83388c3a req-6adb3d07-d883-48e6-8b58-482de7957ac9 tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1175.301939] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1175.302121] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.302414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.302414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.302784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.302872] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.302967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.303073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.303259] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.303404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.303515] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.360465] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abb4b186-60fc-49d0-969b-c0ff0643c8b6 [ 1175.360465] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.360465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.360465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.360672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.360672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.360762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abb4b186-60fc-49d0-969b-c0ff0643c8b6 already deleted. [ 1175.360816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb4b186-60fc-49d0-969b-c0ff0643c8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.636617] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.636936] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.637154] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.637601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.638447] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.638704] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.638896] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.639257] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.639486] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.639809] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.639999] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.640194] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.640377] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.640563] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.640739] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.640950] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.662827] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.663118] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.663310] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.663579] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.664044] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-bdf21675-d603-4f61-b416-46579a930ffc taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.664307] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.664499] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.664972] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.665160] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf21675-d603-4f61-b416-46579a930ffc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.806024] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.806208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.806279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.806503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.806591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.806786] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.806892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.806948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.807084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.807157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.807285] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 already deleted. [ 1175.807348] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.167667] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.168156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.168156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.168297] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.168380] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.168538] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port bdf21675-d603-4f61-b416-46579a930ffc not found, creating... [ 1176.168794] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.168952] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.169084] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.169306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.169443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.169724] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.169894] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.170176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.170327] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.170481] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.170625] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: bdf21675-d603-4f61-b416-46579a930ffc is going to be created. [ 1176.191026] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.191244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.191361] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.191624] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.191845] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.192080] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.918065] env[65469]: INFO networking_nsxv3.common.synchronization [req-35f32c81-85f9-45ec-8967-00fd83388c3a req-8ef482bb-41fa-4971-b1b0-006def49d03c service nova] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1176.918371] env[65469]: INFO networking_nsxv3.common.synchronization [req-35f32c81-85f9-45ec-8967-00fd83388c3a req-8ef482bb-41fa-4971-b1b0-006def49d03c service nova] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1176.918574] env[65469]: INFO networking_nsxv3.common.synchronization [req-35f32c81-85f9-45ec-8967-00fd83388c3a req-8ef482bb-41fa-4971-b1b0-006def49d03c service nova] Enqueued Resource ID: bdf21675-d603-4f61-b416-46579a930ffc with Priority: HIGHEST for action port [ 1176.919253] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1176.919342] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1176.919491] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf21675-d603-4f61-b416-46579a930ffc with Priority: HIGHEST for action port [ 1176.919733] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.919856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.919922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.920151] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.920229] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.921574] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.921793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.921866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.922056] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.922210] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.922303] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.922398] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.922530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.922614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.922701] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.923822] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf21675-d603-4f61-b416-46579a930ffc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.923924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.923992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.924247] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.924326] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf21675-d603-4f61-b416-46579a930ffc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.422854] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.422854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.424539] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.427156] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdf21675-d603-4f61-b416-46579a930ffc with status ACTIVE [ 1177.427156] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.427156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.427156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.427156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.427342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.427476] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.427526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.427563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.427703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.427773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.428423] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.428423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.428423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.428423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.428423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.428423] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdf21675-d603-4f61-b416-46579a930ffc is going to be updated. [ 1177.450762] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.450762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.450762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.451092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.451092] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.451163] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.931360] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.435426] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.435762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.435762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.436378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.436589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.436784] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be created. [ 1178.466805] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.466805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.466805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.467189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.467377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.477654] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: UNINITIALIZED for 2s [ 1180.488908] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1180.489280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.489280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.489468] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.489657] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.489773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.489839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.489989] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.490083] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.490168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.490278] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.992558] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.495513] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55971d60-1eae-4db8-bf19-99bbbc18a8b6: rpc.has_security_group_logging(os_id): False [ 1181.515081] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.515250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.515294] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.515514] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.515630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.515923] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.516043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.516122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.516319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.516464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.516520] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be created. [ 1181.602365] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.602606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.602668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.602848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.603066] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.615282] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: IN_PROGRESS for 2s [ 1181.921866] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1181.922016] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1183.633027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1183.633027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.923330] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1186.923750] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1189.442491] env[65469]: INFO networking_nsxv3.common.synchronization [req-27501ecc-b302-4d36-b8ee-511b6940b725 req-66e549f4-8776-4a54-84bb-1ca498e0a3e2 tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1189.443091] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1189.443412] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.443541] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.443616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.443830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.443982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.444104] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.444161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.444316] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.444401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.445377] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.947049] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.450464] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.952639] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.952855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.952855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.954218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.954218] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.954218] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1190.997483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.997770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.997770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.997894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.998169] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.020965] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1192.949196] env[65469]: INFO networking_nsxv3.common.synchronization [req-5f4b88d4-72f7-452a-a24b-393e1f2d00a8 req-3f812fe2-ae07-40c2-8ea4-c65244acf431 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1192.949802] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGHEST for action security_group_members [ 1192.950139] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.950266] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.950332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.950546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.950727] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.950846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.950909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.951080] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.951158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.951250] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.032032] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1193.032212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.456585] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.456923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.456997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.457359] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.457451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.457767] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.457867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.457910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.458110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.458196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.458282] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 is going to be updated. [ 1193.487191] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.487340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.487414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.487619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.487808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.496689] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: IN_PROGRESS for 2s [ 1195.508601] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 in Status: SUCCESS [ 1195.508976] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 deletion is rescheduled due to dependency. [ 1195.508976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.951232] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.951633] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1199.365157] env[65469]: INFO networking_nsxv3.common.synchronization [req-add53f60-35c8-44dd-a6ff-ca7dcaaf8b74 req-8dd27905-df3f-401d-a608-223fc9794fb5 tempest-ServersTestBootFromVolume-804646923 tempest-ServersTestBootFromVolume-804646923-project-member] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1199.365157] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1199.365434] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.365434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.365520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.365782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.365942] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.366055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.366117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.366273] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.366357] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.366454] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.723916] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.724134] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-964" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.724259] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-964" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.724627] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-964" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.724914] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.725662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.725662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.725877] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.726136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.726379] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.726492] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.726600] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.726707] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.726817] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.726922] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.727064] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.748256] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.748437] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.748568] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.748741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-964" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.749066] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.749242] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.749362] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.749693] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.749832] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f7c8d4-af8d-4490-9c49-a1c720d4b1bc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.868944] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.869208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.869208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.869399] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.869484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.869665] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.869765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.869830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.869962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.870039] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.870236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 already deleted. [ 1199.870313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.252703] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.253039] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.253185] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.253461] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.253688] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.253852] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc not found, creating... [ 1200.254203] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.254377] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.254497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.254734] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.254865] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.255175] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.255344] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.255490] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.255770] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.255912] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.256064] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc is going to be created. [ 1200.294898] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.295242] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.295447] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.295809] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.296150] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.296482] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.976560] env[65469]: INFO networking_nsxv3.common.synchronization [req-add53f60-35c8-44dd-a6ff-ca7dcaaf8b74 req-d181009a-1d0f-4792-b9d9-405d7e92f812 service nova] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1200.976809] env[65469]: INFO networking_nsxv3.common.synchronization [req-add53f60-35c8-44dd-a6ff-ca7dcaaf8b74 req-d181009a-1d0f-4792-b9d9-405d7e92f812 service nova] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1200.976846] env[65469]: INFO networking_nsxv3.common.synchronization [req-add53f60-35c8-44dd-a6ff-ca7dcaaf8b74 req-d181009a-1d0f-4792-b9d9-405d7e92f812 service nova] Enqueued Resource ID: 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc with Priority: HIGHEST for action port [ 1200.977356] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_rules [ 1200.977495] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1200.977590] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc with Priority: HIGHEST for action port [ 1200.977899] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.978035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.978102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.978283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.978364] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.979190] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.979301] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.980339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.980532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.981189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.981189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.981189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.981189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.981189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.981189] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.981953] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.982120] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.982252] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.982319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.982377] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f7c8d4-af8d-4490-9c49-a1c720d4b1bc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.484338] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.484481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.484670] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.485654] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc with status ACTIVE [ 1201.485792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.486187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.486187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.486187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.486325] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.486440] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.486516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.486582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.486746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.486793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.486976] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.487105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.487148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.487261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.487334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.487514] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44f7c8d4-af8d-4490-9c49-a1c720d4b1bc is going to be updated. [ 1201.522079] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.522079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.522079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.522379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.522490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.522760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f7c8d4-af8d-4490-9c49-a1c720d4b1bc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.990088] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.492571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.492739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.492830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.493020] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.493115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.493212] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 is going to be created. [ 1202.516666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.516925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.516925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.517076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.517334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.526317] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: UNINITIALIZED for 2s [ 1204.538523] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: SUCCESS [ 1204.538923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.538923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.539234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.539335] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.539454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.539520] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.539671] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.539751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.539836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.539929] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.889995] env[65469]: INFO networking_nsxv3.common.synchronization [req-6f484ed3-5eb2-49ff-b80b-4a547a93f239 req-23e8d67a-1c87-4787-b29f-5b2c8e4fb1a0 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1204.890545] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGHEST for action security_group_members [ 1204.890869] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.890997] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.891075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.891313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.891431] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.891852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.891852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.891852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.891852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.892067] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.042389] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.396224] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.396448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.396448] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.396677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.396825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.397075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.397177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.397240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.397408] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.397492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.397573] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 is going to be updated. [ 1205.429165] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.429592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.429592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.429592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.429811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.439614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: IN_PROGRESS for 2s [ 1205.545115] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44684c6e-542c-415c-bce8-b0fc93f06081: rpc.has_security_group_logging(os_id): False [ 1205.567176] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.567380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.567431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.567646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.567767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.568132] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.568279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.569028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.569028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.569028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.569028] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 is going to be created. [ 1205.653550] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.653770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.653770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.653970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.654207] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.667072] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: IN_PROGRESS for 2s [ 1206.819726] env[65469]: INFO networking_nsxv3.common.synchronization [req-08f721fa-262b-425c-bb70-f40f469140f8 req-ecd81a5b-c827-4d73-b1e8-0061b0b023ab tempest-ServerActionsTestOtherA-40179697 tempest-ServerActionsTestOtherA-40179697-project-member] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1206.820324] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGHEST for action security_group_members [ 1206.820706] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.820837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.820907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.821193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.821274] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.821365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.821426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.821578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.821666] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.821761] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.324301] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.324481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.324544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.324757] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.324962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.325180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.325280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.325341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.325490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.325566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.325660] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be updated. [ 1207.357474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.357648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.357689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.357867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.358010] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.366082] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: IN_PROGRESS for 2s [ 1207.449412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 in Status: SUCCESS [ 1207.449632] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 deletion is rescheduled due to dependency. [ 1207.449779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.678428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: SUCCESS [ 1207.678609] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.378765] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 in Status: SUCCESS [ 1209.379187] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 deletion is rescheduled due to dependency. [ 1209.379187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.207197] env[65469]: INFO networking_nsxv3.common.synchronization [None req-fc2c8bc8-9cb3-43f1-ac46-2cd8fc2731cb tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1210.207360] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1210.207674] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.207794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.208160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.208546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.208546] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.295646] env[65469]: INFO networking_nsxv3.common.synchronization [None req-ec6b9bfc-c7a1-448f-a3d2-a5b290d3fb76 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1210.296111] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1210.296111] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.296251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.729098] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.729538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.729538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.729630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.729666] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.729752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 already deleted. [ 1210.729868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.730047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.730231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.730315] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.262426] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.262611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.262661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.262863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.262955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.263065] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 already deleted. [ 1211.263146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.296439] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.296746] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.643153] env[65469]: INFO networking_nsxv3.common.synchronization [None req-553b6d1c-c915-4f42-83d4-451002520b05 None None] Enqueued Resource ID: 4f1e316b-598b-4297-a435-8946e09521f2 with Priority: HIGHEST for action port [ 1215.643690] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f1e316b-598b-4297-a435-8946e09521f2 with Priority: HIGHEST for action port [ 1215.644100] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f1e316b-598b-4297-a435-8946e09521f2 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.644175] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f1e316b-598b-4297-a435-8946e09521f2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.644229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f1e316b-598b-4297-a435-8946e09521f2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.644488] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f1e316b-598b-4297-a435-8946e09521f2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.644577] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1e316b-598b-4297-a435-8946e09521f2',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.835620] env[65469]: INFO networking_nsxv3.common.synchronization [req-30c38a15-1e7d-47b1-bb3b-e64acb39a037 req-5cf0f8d2-f368-4faa-9dc8-cf2c5ccfbfcc tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1215.835620] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1215.836094] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.836094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.836404] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.836630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836738] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.836803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.836961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.837616] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.837616] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.125320] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.125582] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.125709] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.126143] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.126326] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.126500] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.127389] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.127389] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.127389] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.127389] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.127389] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.127389] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.127603] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.127603] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.127666] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.127849] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.146759] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f1e316b-598b-4297-a435-8946e09521f2 [ 1216.146982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.147238] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.147485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.147704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.148577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.148577] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f1e316b-598b-4297-a435-8946e09521f2 already deleted. [ 1216.148577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f1e316b-598b-4297-a435-8946e09521f2" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.150397] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.150397] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1216.150397] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.150637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.150967] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-c4e3ae94-2f9a-4713-9d46-9686ab385222 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.151156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.151276] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.151581] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.151724] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e3ae94-2f9a-4713-9d46-9686ab385222',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.339686] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.340073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.340073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.340244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.340454] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.340779] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.340931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.341014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.341192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.341286] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.341372] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 already deleted. [ 1216.341481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.656222] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.656460] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.656608] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.656889] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.657061] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.657221] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port c4e3ae94-2f9a-4713-9d46-9686ab385222 not found, creating... [ 1216.657482] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.657666] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.657744] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.657962] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.658110] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.658524] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.658659] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.658712] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.658911] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.659140] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.659296] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: c4e3ae94-2f9a-4713-9d46-9686ab385222 is going to be created. [ 1216.683238] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.683491] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.683623] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.683943] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.684203] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.684491] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.376574] env[65469]: INFO networking_nsxv3.common.synchronization [req-30c38a15-1e7d-47b1-bb3b-e64acb39a037 req-ddda88ca-4f0a-43ac-b053-d425f8e3fa30 service nova] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1217.376873] env[65469]: INFO networking_nsxv3.common.synchronization [req-30c38a15-1e7d-47b1-bb3b-e64acb39a037 req-ddda88ca-4f0a-43ac-b053-d425f8e3fa30 service nova] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1217.376873] env[65469]: INFO networking_nsxv3.common.synchronization [req-30c38a15-1e7d-47b1-bb3b-e64acb39a037 req-ddda88ca-4f0a-43ac-b053-d425f8e3fa30 service nova] Enqueued Resource ID: c4e3ae94-2f9a-4713-9d46-9686ab385222 with Priority: HIGHEST for action port [ 1217.377419] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_rules [ 1217.377530] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1217.377626] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4e3ae94-2f9a-4713-9d46-9686ab385222 with Priority: HIGHEST for action port [ 1217.377902] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.378527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.378696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.378825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.378912] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.380382] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.380509] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.380577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.380781] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.380922] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.382371] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.382371] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4e3ae94-2f9a-4713-9d46-9686ab385222 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.382371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.383054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.383054] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e3ae94-2f9a-4713-9d46-9686ab385222',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.522704] env[65469]: INFO networking_nsxv3.common.synchronization [None req-db6cdb96-ec27-491e-8454-57e2f870edfe None None] Enqueued Resource ID: ff19bd04-41cd-436a-84e9-660b5983268a with Priority: HIGHEST for action port [ 1217.523303] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff19bd04-41cd-436a-84e9-660b5983268a with Priority: HIGHEST for action port [ 1217.523619] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff19bd04-41cd-436a-84e9-660b5983268a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.523743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff19bd04-41cd-436a-84e9-660b5983268a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.523812] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff19bd04-41cd-436a-84e9-660b5983268a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.524097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff19bd04-41cd-436a-84e9-660b5983268a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.524207] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff19bd04-41cd-436a-84e9-660b5983268a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.884275] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.885271] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.885440] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.886058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4e3ae94-2f9a-4713-9d46-9686ab385222 with status ACTIVE [ 1217.886058] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.886216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.886216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.886501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.886643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.886896] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.887065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.888109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.888109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.888109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.888109] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.888109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.888109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.888410] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.888569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.888706] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4e3ae94-2f9a-4713-9d46-9686ab385222 is going to be updated. [ 1217.910522] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.910784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.910784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.910967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.911111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.911310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4e3ae94-2f9a-4713-9d46-9686ab385222" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.026923] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff19bd04-41cd-436a-84e9-660b5983268a [ 1218.027172] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.027336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.027411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.027633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.027724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.027836] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff19bd04-41cd-436a-84e9-660b5983268a already deleted. [ 1218.027896] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff19bd04-41cd-436a-84e9-660b5983268a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.391331] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.894381] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.894381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.894592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.894719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.894782] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.894900] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 is going to be created. [ 1218.919977] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.920392] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.920475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.920879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.921130] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.932073] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: UNINITIALIZED for 2s [ 1220.842276] env[65469]: INFO networking_nsxv3.common.synchronization [req-80d6fba4-ecdf-4fa9-a1e5-6d0bc340a4b9 req-19cab246-2255-42ba-a28f-5bef593aed8a tempest-ServerTagsTestJSON-1989477686 tempest-ServerTagsTestJSON-1989477686-project-member] Enqueued Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1220.842903] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1220.843310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.843474] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.843552] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.843829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.844016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.844128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.844191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.844347] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.844431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.844522] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.943067] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: SUCCESS [ 1220.943370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.943554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.943846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.944080] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.944222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.944292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.944458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.944539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.944624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.944714] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.131731] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.131961] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.132083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.132423] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.132691] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.132939] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.133316] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.134027] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.134027] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.134027] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.134195] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.134195] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.134305] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.134385] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.134489] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.134619] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.154192] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.154368] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1221.154508] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.154687] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-190" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.155009] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-8fe67130-87a7-40f1-877f-93e91a714e1a taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.155193] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.155311] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.155642] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.155780] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe67130-87a7-40f1-877f-93e91a714e1a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.346393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.346556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.346611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.346846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.346946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.347142] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.347240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.347305] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.347456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.347530] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.347614] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b already deleted. [ 1221.347692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.447263] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.659042] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.659042] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.659042] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.659539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.659539] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.659539] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 8fe67130-87a7-40f1-877f-93e91a714e1a not found, creating... [ 1221.659784] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.659934] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.660163] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.660604] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.660895] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.661374] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.661723] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.661823] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.662322] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.662720] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.663256] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 8fe67130-87a7-40f1-877f-93e91a714e1a is going to be created. [ 1221.686909] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.687124] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.687204] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.687488] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.687721] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.687946] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.950236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93ec76a2-ebab-4757-a221-a85a6ae3b333: rpc.has_security_group_logging(os_id): False [ 1221.967746] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.967970] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.968076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.968332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.968428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.968675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.968776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.968841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.968987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.969085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.969171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 is going to be created. [ 1222.027164] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.027317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.027389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.027603] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.027800] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.038567] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: IN_PROGRESS for 2s [ 1222.392232] env[65469]: INFO networking_nsxv3.common.synchronization [req-80d6fba4-ecdf-4fa9-a1e5-6d0bc340a4b9 req-a94f3175-ac25-4b2d-b587-370166ed1205 service nova] Enqueued Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_rules [ 1222.392413] env[65469]: INFO networking_nsxv3.common.synchronization [req-80d6fba4-ecdf-4fa9-a1e5-6d0bc340a4b9 req-a94f3175-ac25-4b2d-b587-370166ed1205 service nova] Enqueued Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1222.392549] env[65469]: INFO networking_nsxv3.common.synchronization [req-80d6fba4-ecdf-4fa9-a1e5-6d0bc340a4b9 req-a94f3175-ac25-4b2d-b587-370166ed1205 service nova] Enqueued Resource ID: 8fe67130-87a7-40f1-877f-93e91a714e1a with Priority: HIGHEST for action port [ 1222.393072] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_rules [ 1222.393208] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1222.393318] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe67130-87a7-40f1-877f-93e91a714e1a with Priority: HIGHEST for action port [ 1222.393696] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.393796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.393796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.394110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.394143] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.394967] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.395152] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.395220] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.395393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.395539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.395635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.395698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.395836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.395918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.396020] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.397322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe67130-87a7-40f1-877f-93e91a714e1a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.397322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.397322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.397663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.397663] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe67130-87a7-40f1-877f-93e91a714e1a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.898882] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.900044] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.900189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.900404] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fe67130-87a7-40f1-877f-93e91a714e1a with status ACTIVE [ 1222.900666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.900832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.900832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.901059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.901156] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.901337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.901446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.901510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.901684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.901761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.901956] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.902081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.902148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.902290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.902377] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.902463] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fe67130-87a7-40f1-877f-93e91a714e1a is going to be updated. [ 1222.924613] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.924779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.924859] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.925063] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.925232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.925413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe67130-87a7-40f1-877f-93e91a714e1a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.405259] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.908659] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.908863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.908863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.909061] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.909159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.909257] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b is going to be created. [ 1223.932414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.932623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.932710] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.932974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.933188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.947642] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: UNINITIALIZED for 2s [ 1224.052880] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: SUCCESS [ 1224.053094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.332044] env[65469]: INFO networking_nsxv3.common.synchronization [req-0b3b822a-4359-404d-8735-31fdb98f917a req-d5e2bf0f-57a4-4b33-8d8b-b906b5a0eea1 tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1225.332642] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGHEST for action security_group_members [ 1225.335032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.335032] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.335032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.335032] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.837303] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.837502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.837602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.837808] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.837911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.838034] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.838132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.838193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.838342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.838428] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.838513] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 is going to be updated. [ 1225.872282] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.872449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.872510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.872702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.873040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.887380] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: IN_PROGRESS for 2s [ 1225.969640] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: SUCCESS [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.969640] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.969640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.969640] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.471707] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.472168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.472168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.472168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.472425] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.472578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.472641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.472856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.472954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.473024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.473180] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.473268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.473323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.473473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.473606] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.473689] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.474456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.474456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.474456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.474456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.474456] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.976891] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40732f0d-ac9f-4e92-8a96-58a03ddfc53b: rpc.has_security_group_logging(os_id): False [ 1226.998560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.998775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.998775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.998957] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.999059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.999250] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.999372] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.999431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.999589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.999664] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.999867] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.999962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.000043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.000211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.000278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.000473] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.000561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.000621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.000771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.000884] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.000990] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b is going to be created. [ 1227.068057] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.068057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.068334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.068334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.068504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.082138] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: IN_PROGRESS for 2s [ 1227.897739] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65758665-de1b-4948-a04f-b4dbcf296be9 in Status: SUCCESS [ 1227.897972] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 deletion is rescheduled due to dependency. [ 1227.898064] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.098071] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: SUCCESS [ 1229.098318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.333768] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.334133] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1234.185590] env[65469]: INFO networking_nsxv3.common.synchronization [req-1f682bff-74dc-46a1-b39b-f25384bfb26c req-9b94d167-ccec-4b8c-a6e1-4ee9d3a9c178 tempest-ServerTagsTestJSON-1989477686 tempest-ServerTagsTestJSON-1989477686-project-member] Enqueued Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1234.186168] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGHEST for action security_group_members [ 1234.186340] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.186457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.186522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.186723] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.187507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.187507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.187507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.187507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.187507] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.187507] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.690403] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.690623] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.690685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.691034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.691192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.691383] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.691487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.691581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.691791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.691909] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.692027] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b is going to be updated. [ 1234.726919] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.726919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.726919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.726919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.726919] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.736403] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: IN_PROGRESS for 2s [ 1236.747632] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b in Status: SUCCESS [ 1236.747632] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b deletion is rescheduled due to dependency. [ 1236.748162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.186946] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.187359] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.187714] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.188153] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1249.188857] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.188857] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.189472] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.189923] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.213755] env[65469]: INFO networking_nsxv3.common.synchronization [req-3cc3448d-79e8-4c73-98d8-0db865d6f47d req-3b5d35df-7320-4143-b478-bcdc8be275f8 tempest-ServersTestBootFromVolume-804646923 tempest-ServersTestBootFromVolume-804646923-project-member] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1254.213755] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGHEST for action security_group_members [ 1254.213755] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.213755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.213755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.213755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.214167] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.214291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.214344] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.214542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.214619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.214726] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.717591] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.717770] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.717921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.718117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.718231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.718508] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.718663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.718742] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.718908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.718999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.719114] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 is going to be updated. [ 1254.747016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.747328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.747328] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.747450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.747574] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.757116] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: IN_PROGRESS for 2s [ 1254.795988] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.796290] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.796387] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.796789] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.797360] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.797562] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.797690] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.797957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.798174] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.798398] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.798537] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.798649] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.798758] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.798882] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.799011] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.799165] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.820282] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.820515] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1254.820619] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.820805] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.821197] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-bdf21675-d603-4f61-b416-46579a930ffc taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.821377] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.821533] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.821792] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.821942] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf21675-d603-4f61-b416-46579a930ffc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.028800] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1255.029064] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:3 started [ 1255.324239] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.324534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.324621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.324901] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.325062] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.325361] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.325517] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.325636] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.325854] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.325989] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.326278] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.326447] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.326545] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.326744] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.326872] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.327016] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: bdf21675-d603-4f61-b416-46579a930ffc is going to be updated. [ 1255.354766] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.354995] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.355122] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.355497] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.355727] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.355984] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.089718] env[65469]: INFO networking_nsxv3.common.synchronization [req-f68177bf-2282-4062-a0f9-e31271a64e5d req-cc3733f2-f654-442c-a7be-e40f1cb02480 service nova] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1256.090226] env[65469]: INFO networking_nsxv3.common.synchronization [req-f68177bf-2282-4062-a0f9-e31271a64e5d req-cc3733f2-f654-442c-a7be-e40f1cb02480 service nova] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1256.090226] env[65469]: INFO networking_nsxv3.common.synchronization [req-f68177bf-2282-4062-a0f9-e31271a64e5d req-cc3733f2-f654-442c-a7be-e40f1cb02480 service nova] Enqueued Resource ID: bdf21675-d603-4f61-b416-46579a930ffc with Priority: HIGHEST for action port [ 1256.090822] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_rules [ 1256.091053] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1256.091291] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf21675-d603-4f61-b416-46579a930ffc with Priority: HIGHEST for action port [ 1256.091672] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.091831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.091938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.092195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.092283] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.093856] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.093965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.094043] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.094239] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.094424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.094508] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.095645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.095645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.095645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.095645] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.096710] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf21675-d603-4f61-b416-46579a930ffc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.096932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.097054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.097241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.097325] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf21675-d603-4f61-b416-46579a930ffc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.598234] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.599414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.599539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.599899] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdf21675-d603-4f61-b416-46579a930ffc with status ACTIVE [ 1256.600075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.600205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.600255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.600447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.600555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.600704] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.600848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.600848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.601017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.601118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601304] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.601396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.601453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.601591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.601663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601743] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdf21675-d603-4f61-b416-46579a930ffc is going to be updated. [ 1256.623356] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.623566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.623566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.623751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.623885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.624053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf21675-d603-4f61-b416-46579a930ffc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.767273] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44684c6e-542c-415c-bce8-b0fc93f06081 in Status: SUCCESS [ 1256.767466] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 deletion is rescheduled due to dependency. [ 1256.767561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.100506] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.603754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.604228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.604228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.604228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.604364] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.604422] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be updated. [ 1257.632571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.632790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.632790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.632983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.633315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.641994] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: IN_PROGRESS for 2s [ 1259.653498] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1259.653841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.653906] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.654144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.654357] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.654506] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.654593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.654765] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.654849] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.654933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.655033] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.785195] env[65469]: INFO networking_nsxv3.common.synchronization [req-ad18df7b-ba1a-40b6-abe0-00570308e895 req-dfa15995-efbc-4502-aabe-359c8f0510df tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1259.787168] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1259.788388] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.788492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.788594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.788950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.789158] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.789323] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.789797] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.789993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.790115] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.790271] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.156956] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.293189] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.293374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.293447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.293678] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.293737] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.293958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.294073] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.294153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.294317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.294413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.294511] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1260.326803] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.326993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.327050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.327429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.327429] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.336192] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1260.661372] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55971d60-1eae-4db8-bf19-99bbbc18a8b6: rpc.has_security_group_logging(os_id): False [ 1260.683347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.683591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.683591] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.683838] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.683935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.684241] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.684388] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.684456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.684645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.684726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.684815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be updated. [ 1260.755014] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.755211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.755287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.755442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.755610] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.773407] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: IN_PROGRESS for 2s [ 1262.155592] env[65469]: INFO networking_nsxv3.common.synchronization [req-a18b2f8f-9c6d-4b2e-b980-1f430e114ab2 req-b81a5212-ff05-4247-8dd8-293c661b8b1c tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1262.156009] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1262.156387] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.156557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.156669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.156982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.157161] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.157349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.157400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.157606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.157754] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.157892] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.348323] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1262.348640] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 deletion is rescheduled due to dependency. [ 1262.348775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.660898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.661194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.661194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.661334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.661459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.661630] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.662250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.662250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.662250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.662250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.662250] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1262.690524] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.690810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.690810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.691048] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.691411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.700809] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1262.786562] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1262.787276] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.718760] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1264.719119] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a deletion is rescheduled due to dependency. [ 1264.719119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.156935] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.157338] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.619607] env[65469]: INFO networking_nsxv3.common.synchronization [req-e0767ca1-d5f4-4984-b089-dd3ba5c5b1f5 req-4da1f315-f8d6-49dc-b674-02a37c5c5af4 tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1269.620174] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1269.620492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.620614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.620686] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.620882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.621075] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.621206] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.621290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.621450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.621538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.621633] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.915737] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.915942] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.916078] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.916345] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.916594] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.916746] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.916861] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.917129] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.917282] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.917489] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.917602] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.917709] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.917817] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.917925] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.918040] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.918171] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.942020] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.942020] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1269.942020] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.942020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.942020] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-a75532e4-890f-4344-b349-9a00b869bb68 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.942020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.942020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.942020] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.942020] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75532e4-890f-4344-b349-9a00b869bb68',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.124483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.124483] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.124803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.124861] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.125029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.125339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.125496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.125597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.125820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.125927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.126025] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1270.152300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.152535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.152535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.152690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.152828] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.163571] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1270.444708] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.444950] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.445332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.445332] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.445463] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.445625] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port a75532e4-890f-4344-b349-9a00b869bb68 not found, creating... [ 1270.446040] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.446040] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.446159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.446356] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.446492] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.446769] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.446924] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.447064] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.447306] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.447443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.447580] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: a75532e4-890f-4344-b349-9a00b869bb68 is going to be created. [ 1270.467779] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.468031] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.468134] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.468387] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.468620] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.468867] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.218865] env[65469]: INFO networking_nsxv3.common.synchronization [req-e0767ca1-d5f4-4984-b089-dd3ba5c5b1f5 req-b2157250-5e98-48cb-8680-f702cf18ec18 service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 1271.219233] env[65469]: INFO networking_nsxv3.common.synchronization [req-e0767ca1-d5f4-4984-b089-dd3ba5c5b1f5 req-b2157250-5e98-48cb-8680-f702cf18ec18 service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1271.219233] env[65469]: INFO networking_nsxv3.common.synchronization [req-e0767ca1-d5f4-4984-b089-dd3ba5c5b1f5 req-b2157250-5e98-48cb-8680-f702cf18ec18 service nova] Enqueued Resource ID: a75532e4-890f-4344-b349-9a00b869bb68 with Priority: HIGHEST for action port [ 1271.219752] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 1271.219890] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1271.219989] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75532e4-890f-4344-b349-9a00b869bb68 with Priority: HIGHEST for action port [ 1271.220292] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.220437] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.220569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.220676] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.220738] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.221987] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.222116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.222310] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-a75532e4-890f-4344-b349-9a00b869bb68 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.222411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.222519] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.222707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.222781] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75532e4-890f-4344-b349-9a00b869bb68',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.725097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.725263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.725407] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a75532e4-890f-4344-b349-9a00b869bb68 with status ACTIVE [ 1271.725575] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.725683] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.725745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.726529] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.726529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.726858] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.726858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.726858] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.726953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.727033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.727121] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a75532e4-890f-4344-b349-9a00b869bb68 is going to be updated. [ 1271.748443] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.748612] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.748697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.748938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.749112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.749313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a75532e4-890f-4344-b349-9a00b869bb68" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.173041] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1272.173266] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 deletion is rescheduled due to dependency. [ 1272.173381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.173542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.173753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.173921] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.174047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.174105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.174292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.174376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.174472] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.677079] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.182275] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.684500] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.684803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.684803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.684976] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.685060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.685152] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1273.712608] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.712847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.712847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.713037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.713180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.721963] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1274.077116] env[65469]: INFO networking_nsxv3.common.synchronization [req-3e7bcd13-f0f8-4965-b216-3fa8f777f888 req-c87ad963-ba64-42e0-996a-ac90b82e31d3 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1274.077667] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1274.077983] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.078116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.078185] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.078379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.078527] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.078622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.078684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.078845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.078914] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.079130] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.366781] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.367069] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.367265] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.367601] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.367866] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.368034] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.368156] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.368393] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.368509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.368714] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.368826] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.368934] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.369050] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.370047] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.370047] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.370047] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.389126] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.389329] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.389490] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.389670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.389989] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-528db453-711d-45aa-8edf-2ece09cf9f02 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.390176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.390296] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.390640] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.390779] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528db453-711d-45aa-8edf-2ece09cf9f02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.582137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.582137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.582137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.582137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.582137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.582461] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.582461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.582461] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.582557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.582557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.582687] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1274.611298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.611478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.611595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.611753] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.611893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.620815] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1274.893709] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.894205] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.894205] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.894613] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.894784] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.894948] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 528db453-711d-45aa-8edf-2ece09cf9f02 not found, creating... [ 1274.895237] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.895402] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.895521] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.895754] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.895893] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.896196] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.896375] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.896564] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.896816] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.896954] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.897109] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 528db453-711d-45aa-8edf-2ece09cf9f02 is going to be created. [ 1274.920053] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.920277] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.920390] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.920684] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.920909] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.921158] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.628369] env[65469]: INFO networking_nsxv3.common.synchronization [req-3e7bcd13-f0f8-4965-b216-3fa8f777f888 req-ae6d5789-98ce-4d37-ac0e-e263b918dbe0 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1275.628959] env[65469]: INFO networking_nsxv3.common.synchronization [req-3e7bcd13-f0f8-4965-b216-3fa8f777f888 req-ae6d5789-98ce-4d37-ac0e-e263b918dbe0 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1275.629137] env[65469]: INFO networking_nsxv3.common.synchronization [req-3e7bcd13-f0f8-4965-b216-3fa8f777f888 req-ae6d5789-98ce-4d37-ac0e-e263b918dbe0 service nova] Enqueued Resource ID: 528db453-711d-45aa-8edf-2ece09cf9f02 with Priority: HIGHEST for action port [ 1275.629626] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1275.629762] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1275.629860] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 528db453-711d-45aa-8edf-2ece09cf9f02 with Priority: HIGHEST for action port [ 1275.630143] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.630261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.630350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.630522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.630601] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.631483] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.631608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.631871] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-528db453-711d-45aa-8edf-2ece09cf9f02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.631871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.631991] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.632094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.632171] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528db453-711d-45aa-8edf-2ece09cf9f02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.732146] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1275.732374] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.732561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.732755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.732948] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.733076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.733143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.733365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.733462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.733528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.733619] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.134361] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.134796] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.134796] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 528db453-711d-45aa-8edf-2ece09cf9f02 with status ACTIVE [ 1276.134880] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.134960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.135037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.135250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.135335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.135502] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.135657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.135727] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.135886] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.135961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.136171] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.136268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.136336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.136475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.136547] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.136627] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 528db453-711d-45aa-8edf-2ece09cf9f02 is going to be updated. [ 1276.158705] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.158912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.158912] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.159124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.159263] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.159423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.235398] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.631208] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1276.631414] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a deletion is rescheduled due to dependency. [ 1276.631546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.632308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.632308] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.632308] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.632518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.632518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.632587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.632660] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.632759] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.738770] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8608a4da-285d-4dc3-aa08-db64404925d5: rpc.has_security_group_logging(os_id): False [ 1276.756988] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.757155] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.757216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.757421] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.757516] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.757754] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.757867] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.757918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.758148] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.758211] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.758242] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1276.818425] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.818643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.818643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.818905] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.819109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.831162] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1277.135454] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.638684] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.142137] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.142605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.142605] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.142720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.142978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.143137] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1278.173675] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.173675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.173675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.173675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.173675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.182744] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1278.844506] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1278.844805] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.071551] env[65469]: INFO networking_nsxv3.common.synchronization [req-12a9d146-5d33-4166-95e5-5d21a36ea3e9 req-83e0b78a-b59b-4f77-8d76-b3c751b0017b tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1280.072192] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGHEST for action security_group_members [ 1280.072503] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.072668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.072835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.073656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.073656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.073656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.073656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.073656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.073891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.073891] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.193881] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1280.194119] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.194322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.194528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.194704] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.194827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.194892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.195059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.195141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.195228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.195348] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.576922] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.577214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.577312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.577553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.577648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.577860] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.578019] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.578124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.578311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.578394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.578485] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 is going to be updated. [ 1280.608255] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.608462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.608462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.608652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.608793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.617953] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: IN_PROGRESS for 2s [ 1280.697845] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.200696] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 1281.221861] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.222076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.222076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.222307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.222400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.222650] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.222748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.222810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.223033] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.223090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.223366] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1281.303219] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.303411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.303484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.303697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.303848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.315649] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1282.628736] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 in Status: SUCCESS [ 1282.629231] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 deletion is rescheduled due to dependency. [ 1282.629231] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.328043] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1283.328209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.850035] env[65469]: INFO networking_nsxv3.common.synchronization [None req-692c4e43-2735-40d9-bf0f-a122cbf7525c tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1284.850589] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1284.850999] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.851379] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.851497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.851846] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.851963] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.931360] env[65469]: INFO networking_nsxv3.common.synchronization [None req-467f4e05-c12f-4198-abfd-e165e0b6a7bf tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1284.932233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1284.932701] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.932855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.375829] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.375829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.375829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.375829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.376246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.376246] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 already deleted. [ 1285.376246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.376246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.376449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.376449] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.897263] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.897827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.897827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.897827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.897928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.898023] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 already deleted. [ 1285.898177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.933023] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.933497] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.370040] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf0251f7-70a8-403e-bf16-86a265ab4867 req-751ab7aa-a567-4896-90c6-124f43708a27 tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1290.370490] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1290.370753] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.370895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.370952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.371210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.371363] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.371475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.371538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.371699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.371785] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.371875] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.679701] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.679975] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.680136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.680403] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.680668] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.680820] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.680933] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.681159] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.681299] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.681526] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.681638] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1290.681751] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1290.681849] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1290.681954] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.682074] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1290.682204] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1290.703541] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1290.703541] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1290.703541] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1290.703797] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-748" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.704018] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-6fef32ef-94cd-4314-8e3d-4684540cbd7e taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.704192] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.704310] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.704638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.704775] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fef32ef-94cd-4314-8e3d-4684540cbd7e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.874632] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.874871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.874871] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.875129] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.875226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.875429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.875533] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.875594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.875755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.875831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.875995] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 already deleted. [ 1290.875995] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.207419] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.207817] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.207817] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.208043] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.208195] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.208382] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 6fef32ef-94cd-4314-8e3d-4684540cbd7e not found, creating... [ 1291.208670] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.208828] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.208948] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.209191] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.209326] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.209602] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.209757] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.209879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.210096] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.210230] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.210368] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 6fef32ef-94cd-4314-8e3d-4684540cbd7e is going to be created. [ 1291.230211] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.230460] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.230621] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.230790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.231027] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.231278] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.921717] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf0251f7-70a8-403e-bf16-86a265ab4867 req-199047b1-620a-4a76-aee3-277bf7f1d3a8 service nova] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1291.921898] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf0251f7-70a8-403e-bf16-86a265ab4867 req-199047b1-620a-4a76-aee3-277bf7f1d3a8 service nova] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1291.922069] env[65469]: INFO networking_nsxv3.common.synchronization [req-bf0251f7-70a8-403e-bf16-86a265ab4867 req-199047b1-620a-4a76-aee3-277bf7f1d3a8 service nova] Enqueued Resource ID: 6fef32ef-94cd-4314-8e3d-4684540cbd7e with Priority: HIGHEST for action port [ 1291.922560] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_rules [ 1291.922698] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1291.922795] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fef32ef-94cd-4314-8e3d-4684540cbd7e with Priority: HIGHEST for action port [ 1291.923092] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.923227] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.923279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.923523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.923605] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.924438] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.924575] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.924658] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.924824] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.924969] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.925090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.925138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.925265] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.925351] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.925436] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.926127] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fef32ef-94cd-4314-8e3d-4684540cbd7e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.926233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.926298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.926442] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.926511] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fef32ef-94cd-4314-8e3d-4684540cbd7e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.428358] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.428740] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.428740] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.429609] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fef32ef-94cd-4314-8e3d-4684540cbd7e with status ACTIVE [ 1292.429739] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.429739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.429847] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.429978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.430312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.430312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.430312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.430457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.430543] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.430618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.430792] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.430883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.430938] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.431086] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.431158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.431236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fef32ef-94cd-4314-8e3d-4684540cbd7e is going to be updated. [ 1292.452046] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.452228] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.452280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.452447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.452613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.452780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fef32ef-94cd-4314-8e3d-4684540cbd7e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.933502] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.436051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.436391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.436391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.436503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.436592] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.436701] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 is going to be created. [ 1293.460386] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.460641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.460641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.460791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.460951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.470347] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: UNINITIALIZED for 2s [ 1295.481270] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: SUCCESS [ 1295.481681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.481681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.481841] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.482065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.482189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.482255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.482415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.482494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.482578] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.482665] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.985284] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.487876] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be415275-bc89-4178-b92c-b8aef3d69eb5: rpc.has_security_group_logging(os_id): False [ 1296.505397] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.505595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.505595] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.505801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.505891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.506144] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.506246] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.506310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.506463] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.506542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.506626] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 is going to be created. [ 1296.565966] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.566146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.566223] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.566441] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.566621] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.576583] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: IN_PROGRESS for 2s [ 1296.923865] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.924094] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1297.975260] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.975692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.975692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.975692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.975823] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.477795] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.591058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: SUCCESS [ 1298.591287] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.980428] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.483408] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1299.483586] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1300.252861] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.253241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.253241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.253370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.264735] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1300.265608] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.266802] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1300.303298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.303569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.303569] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.303698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.315641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.316466] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1300.316581] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.316658] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1300.370771] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.371054] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.371113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.371415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.373363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.373609] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1300.458298] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.458572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.458572] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.458709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.459044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.459338] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1300.533725] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.533874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.533923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.534135] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.534444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.534827] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1300.534905] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'858870d8-a7bb-4e33-8a8a-f46123eb652e', '3bf5e51a-42c7-4d46-b6da-54474ae7b623', '7ff0417e-ec9b-4d09-9e53-7e07d24399c0', '55971d60-1eae-4db8-bf19-99bbbc18a8b6', '65758665-de1b-4948-a04f-b4dbcf296be9', 'c6f27ff1-776e-4a70-90a6-ebc268939e44', '5be86bbb-df18-464c-9cd6-f07241444961', '8608a4da-285d-4dc3-aa08-db64404925d5', '709a1070-5186-40a8-ad7e-f0a18412647f', '885e7f1b-e47b-4285-ab7d-029f48a54f6a', '44684c6e-542c-415c-bce8-b0fc93f06081', 'd0450b87-9656-4a30-b7b0-3f5285ac5d52', '1800bc34-66c0-4e6c-973e-252547c5c4e1', '4e6975d0-2064-42d1-b410-13058e6b3c61', '40732f0d-ac9f-4e92-8a96-58a03ddfc53b', 'e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d', 'd287eaed-f226-46a7-8661-38075c224166', '2456e406-10ff-453e-9e7e-01913e34d9c7', '4678c753-8db4-4c5c-893f-3e320ded5c02', '6c63cff5-58e6-4b63-8e2b-267cac3740b5', 'b72348dc-32e6-4663-85f1-f411e222a7a4', '93250c38-ef03-4516-b959-0aa8baeef74a', 'fb6e69ce-aa18-43cb-be60-af4e37502a7a', 'b309be15-6460-49da-bd48-e95c49f1421b', '5bde506b-06fa-4939-b031-63dc38218dcc', '92bf433d-c39b-4344-960c-b8e0607c3036', '8c49bdcf-f8e3-4883-b509-795a54e2f950', '0e0e254f-6737-4701-b8b1-b6906deeb63f', '641bf348-fb8f-499f-a944-4cb315e55733', '5faeab0c-fd4f-463f-b917-048fa4f0ebd1', 'f1fe9c7b-391a-4964-94bd-fd69c7fb232c', '7663bbf6-b391-494e-9a60-db9d723b0635', 'ab3db8e0-1f52-4d95-9b58-4be9adf31de9', '3ad20fef-905e-4efe-bdf9-75c98decc63b', '5863af48-2574-424a-a51b-dcfeb0d1a63d', '470f3367-e1b6-4e76-8701-774a6b0e92ae', '93ec76a2-ebab-4757-a221-a85a6ae3b333', '2f4f7ec7-5508-45fa-9dca-52ca3bb66953', '2d3a53e0-bc08-4699-b179-a2a446524a23', '1222eeb9-9dbe-496c-9f03-31010145cde2', 'aa96ab4a-8a16-4875-8013-1f1b9504c258', 'fd6b3522-babc-4977-91f4-6a81f2f59e88', 'be415275-bc89-4178-b92c-b8aef3d69eb5', '1f756a88-e1c6-407c-9a54-9002d0c269ee', 'dac16e76-d38a-4051-af09-b9b6e58acda0'} {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.534905] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1300.553905] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.554245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.554383] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.554607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.554835] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.554952] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1300.555044] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.555121] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1300.630598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.630810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.630810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.630999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.632125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.632412] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1300.632482] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.632552] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1300.632617] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1300.632694] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1300.632767] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGH for action security_group_rules [ 1300.632856] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGH for action security_group_rules [ 1300.632964] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGH for action security_group_rules [ 1300.633080] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGH for action security_group_rules [ 1300.633191] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGH for action security_group_rules [ 1300.633284] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGH for action security_group_rules [ 1300.633356] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGH for action security_group_rules [ 1300.633420] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1300.633506] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 1300.633569] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGH for action security_group_rules [ 1300.633636] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGH for action security_group_rules [ 1300.633697] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 1300.633771] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGH for action security_group_rules [ 1300.633834] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 1300.633896] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGH for action security_group_rules [ 1300.633957] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGH for action security_group_rules [ 1300.634033] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGH for action security_group_rules [ 1300.634097] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGH for action security_group_rules [ 1300.634159] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGH for action security_group_rules [ 1300.634220] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGH for action security_group_rules [ 1300.634318] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.925197] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.925576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1301.925576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e with Priority: HIGH for action security_group_rules [ 1301.925576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 with Priority: HIGH for action security_group_rules [ 1301.925696] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be86bbb-df18-464c-9cd6-f07241444961 with Priority: HIGH for action security_group_rules [ 1301.925739] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b with Priority: HIGH for action security_group_rules [ 1301.925927] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 with Priority: HIGH for action security_group_rules [ 1301.925927] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 with Priority: HIGH for action security_group_rules [ 1301.926085] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 with Priority: HIGH for action security_group_rules [ 1301.926085] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d287eaed-f226-46a7-8661-38075c224166 with Priority: HIGH for action security_group_rules [ 1301.926184] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 with Priority: HIGH for action security_group_rules [ 1301.926263] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d with Priority: HIGH for action security_group_rules [ 1301.926355] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 with Priority: HIGH for action security_group_rules [ 1301.926443] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 with Priority: HIGH for action security_group_rules [ 1301.926533] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44684c6e-542c-415c-bce8-b0fc93f06081 with Priority: HIGH for action security_group_rules [ 1301.926622] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGH for action security_group_rules [ 1301.926708] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709a1070-5186-40a8-ad7e-f0a18412647f with Priority: HIGH for action security_group_rules [ 1301.926794] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 with Priority: HIGH for action security_group_rules [ 1301.926880] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1301.926966] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65758665-de1b-4948-a04f-b4dbcf296be9 with Priority: HIGH for action security_group_rules [ 1301.927063] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 with Priority: HIGH for action security_group_rules [ 1301.927160] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGH for action security_group_rules [ 1301.927494] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858870d8-a7bb-4e33-8a8a-f46123eb652e taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.927634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.927701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.927910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.927994] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858870d8-a7bb-4e33-8a8a-f46123eb652e',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.929016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.929140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.929208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.929385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.929459] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0417e-ec9b-4d09-9e53-7e07d24399c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.930769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5be86bbb-df18-464c-9cd6-f07241444961 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.930885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.930939] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.931313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.931313] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5be86bbb-df18-464c-9cd6-f07241444961',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.931848] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.931956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.932515] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.932704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.932786] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40732f0d-ac9f-4e92-8a96-58a03ddfc53b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.933835] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.933966] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.934060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.934193] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.934397] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c63cff5-58e6-4b63-8e2b-267cac3740b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.935328] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4678c753-8db4-4c5c-893f-3e320ded5c02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.935481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.935513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.935653] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.935726] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4678c753-8db4-4c5c-893f-3e320ded5c02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.937186] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2456e406-10ff-453e-9e7e-01913e34d9c7 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.937186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.937186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.937186] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.937412] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2456e406-10ff-453e-9e7e-01913e34d9c7',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.940408] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d287eaed-f226-46a7-8661-38075c224166 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.940521] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.940581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.940801] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.940879] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d287eaed-f226-46a7-8661-38075c224166',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.941782] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e6975d0-2064-42d1-b410-13058e6b3c61 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.941893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.941958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.942251] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.942251] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e6975d0-2064-42d1-b410-13058e6b3c61',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.942898] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.943017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.943085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.943234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.943305] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.943989] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1800bc34-66c0-4e6c-973e-252547c5c4e1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.944690] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.944868] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.945047] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.945125] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1800bc34-66c0-4e6c-973e-252547c5c4e1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.946373] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.946550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.946550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.946657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.946850] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0450b87-9656-4a30-b7b0-3f5285ac5d52',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.947864] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44684c6e-542c-415c-bce8-b0fc93f06081 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.947864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.948029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.948078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.948286] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44684c6e-542c-415c-bce8-b0fc93f06081',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.949013] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.949128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.949194] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.949343] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.949415] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.950088] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-709a1070-5186-40a8-ad7e-f0a18412647f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.950196] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.950258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.950402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.950473] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('709a1070-5186-40a8-ad7e-f0a18412647f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.951399] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6f27ff1-776e-4a70-90a6-ebc268939e44 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.951581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.951688] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.951798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.951877] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6f27ff1-776e-4a70-90a6-ebc268939e44',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.952528] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.952649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.952739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.952874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.952970] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.953686] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65758665-de1b-4948-a04f-b4dbcf296be9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.953795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.953795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.953901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.953972] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65758665-de1b-4948-a04f-b4dbcf296be9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.954730] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.954851] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.954922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.955309] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.955309] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf5e51a-42c7-4d46-b6da-54474ae7b623',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.955824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.955931] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.956072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.956132] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.956471] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.996839] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.997070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.997070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.997270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.998942] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.999070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.999761] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.999860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.000766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.001335] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.001997] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.002161] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.021985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.022150] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e6975d0-2064-42d1-b410-13058e6b3c61 is going to be deleted. [ 1302.023011] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.023233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.045493] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.045654] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40732f0d-ac9f-4e92-8a96-58a03ddfc53b is going to be deleted. [ 1302.046776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.046776] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.073656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.073824] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d is going to be deleted. [ 1302.074687] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.074894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.082307] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.082501] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.108455] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.108692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.118321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.118449] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0417e-ec9b-4d09-9e53-7e07d24399c0 is going to be deleted. [ 1302.119365] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.119580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.147373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.147564] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858870d8-a7bb-4e33-8a8a-f46123eb652e is going to be deleted. [ 1302.148469] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.148695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.148822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.148951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e6975d0-2064-42d1-b410-13058e6b3c61" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.149136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.149292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.149370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.149478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40732f0d-ac9f-4e92-8a96-58a03ddfc53b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.150586] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.150708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.150775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.150924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.151094] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.151146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e635fe1a-61cb-4e4c-aec4-ebcfb16fde5d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.271102] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.271358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.271358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.271525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.271617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.271771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0417e-ec9b-4d09-9e53-7e07d24399c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.286445] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.286652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.286652] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.286850] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.286942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.287079] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858870d8-a7bb-4e33-8a8a-f46123eb652e" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.459682] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.459900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.459900] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.460101] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.460260] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.460356] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.460417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.460563] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.460648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.460730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.460813] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.468064] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.468240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.468289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.468451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.468606] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.468704] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.468762] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.468910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.468992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.469088] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.469170] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.472172] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.472283] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.472350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.472526] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.472671] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.472763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.472822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.472956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.473050] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.473131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.473212] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.480192] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.480340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.480384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.480580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.482108] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.482229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.484362] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.484465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.500877] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.501100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.511532] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.511716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.524728] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.524948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.525658] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.525774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.526539] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.526633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.527312] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.527409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.528080] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.528178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.528917] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.529022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.529597] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1302.529982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.530089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.535487] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1302.535954] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.536083] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4678c753-8db4-4c5c-893f-3e320ded5c02 is going to be deleted. [ 1302.537030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.537236] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.555170] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.555271] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0450b87-9656-4a30-b7b0-3f5285ac5d52 is going to be deleted. [ 1302.556112] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.556312] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.580089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.580258] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2456e406-10ff-453e-9e7e-01913e34d9c7 is going to be deleted. [ 1302.581140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.581350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.602851] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.602978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.609559] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.609720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.615561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.615702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5be86bbb-df18-464c-9cd6-f07241444961 is going to be deleted. [ 1302.616617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.616875] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.670384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.670619] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6f27ff1-776e-4a70-90a6-ebc268939e44 is going to be deleted. [ 1302.671528] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.671774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.691716] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.691951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.701894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.702063] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 709a1070-5186-40a8-ad7e-f0a18412647f is going to be deleted. [ 1302.702937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.703167] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.704669] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.704788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.753602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.753779] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c63cff5-58e6-4b63-8e2b-267cac3740b5 is going to be deleted. [ 1302.754885] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.755125] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.780627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.780827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.818820] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.818987] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1800bc34-66c0-4e6c-973e-252547c5c4e1 is going to be deleted. [ 1302.819848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.820213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.826138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.826349] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.887481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.887664] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d287eaed-f226-46a7-8661-38075c224166 is going to be deleted. [ 1302.888649] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.888888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.901982] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.902192] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.940599] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.941038] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65758665-de1b-4948-a04f-b4dbcf296be9 is going to be deleted. [ 1302.941760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.941992] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.963315] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.963555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.965829] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.975576] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.983540] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.001969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.002195] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44684c6e-542c-415c-bce8-b0fc93f06081 is going to be deleted. [ 1303.003780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.004016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.019253] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.019481] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.063158] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.063346] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.064173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.064287] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf5e51a-42c7-4d46-b6da-54474ae7b623 is going to be deleted. [ 1303.065233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.065446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.065540] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.065695] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4678c753-8db4-4c5c-893f-3e320ded5c02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.065874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.066051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.066138] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.066272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0450b87-9656-4a30-b7b0-3f5285ac5d52" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.066822] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.066982] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.067081] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.067202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5be86bbb-df18-464c-9cd6-f07241444961" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.067337] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.067484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.067580] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.067701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2456e406-10ff-453e-9e7e-01913e34d9c7" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.067832] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.067993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.068133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.068264] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6f27ff1-776e-4a70-90a6-ebc268939e44" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.068396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.068542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.068618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.068736] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-709a1070-5186-40a8-ad7e-f0a18412647f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.069024] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.069180] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.069257] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.069373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c63cff5-58e6-4b63-8e2b-267cac3740b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.069504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.069643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.069719] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.069830] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1800bc34-66c0-4e6c-973e-252547c5c4e1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.069956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.070110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.070183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.070298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d287eaed-f226-46a7-8661-38075c224166" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.070431] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.070566] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.070645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.070998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65758665-de1b-4948-a04f-b4dbcf296be9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.157020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.157334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.157334] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.157457] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.157529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.157700] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44684c6e-542c-415c-bce8-b0fc93f06081" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.244597] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.244934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.244934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.245027] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.245114] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.245221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf5e51a-42c7-4d46-b6da-54474ae7b623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.468460] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8608a4da-285d-4dc3-aa08-db64404925d5: rpc.has_security_group_logging(os_id): False [ 1303.477278] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 1303.486029] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55971d60-1eae-4db8-bf19-99bbbc18a8b6: rpc.has_security_group_logging(os_id): False [ 1303.490199] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.490373] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.490411] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.490634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.493938] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.494160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.503560] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.503792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.514150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.514431] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.514532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.514579] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.514773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.514855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.514949] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1303.515986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.516260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.534327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.534614] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.534707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.534772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.534958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.535051] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.535135] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1303.536128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.536291] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.553458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.553783] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.553904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.554070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.554187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.554271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.554359] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be updated. [ 1303.587687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.587895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.587895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.588053] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.588201] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.599396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.599588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.599588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.599790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.599932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.604956] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1303.618189] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1303.620888] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.620888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.620888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.620888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.620888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.642268] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: IN_PROGRESS for 2s [ 1305.619150] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1305.619523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.629677] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1305.630049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.654752] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1305.654996] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.928434] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.928751] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.929735] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.929735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.216329] env[65469]: INFO networking_nsxv3.common.synchronization [req-ce8c9ba7-bf5c-4220-a216-95b5bb0219ad req-2193d7c0-9bb3-416b-adfa-304f693dab5b tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1315.216870] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGHEST for action security_group_members [ 1315.217950] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.217950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.217950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.217950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.217950] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.218299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.218299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.218299] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.218393] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.218462] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.721475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.721711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.721711] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.721917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.722023] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.722216] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.722319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.722376] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.722529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.722602] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.722687] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be updated. [ 1315.752158] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.752380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.752380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.752558] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.752699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.761742] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: IN_PROGRESS for 2s [ 1317.773054] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 in Status: SUCCESS [ 1317.773438] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 deletion is rescheduled due to dependency. [ 1317.773438] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.881034] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a6372259-310b-4bbe-a031-016400a5d309 tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1319.881530] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1319.881772] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.881895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.881961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.882232] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.882322] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.968268] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8123de43-df1c-420c-b48b-80149a37a516 tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1319.968703] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1319.969033] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.969165] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.404261] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.404450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.404492] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.404691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.404816] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.404865] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 already deleted. [ 1320.404945] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.405109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.405425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.405425] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.924254] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.924709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.924709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.924709] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.924840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.924840] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 already deleted. [ 1320.924902] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.969862] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.970211] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1326.416154] env[65469]: INFO networking_nsxv3.common.synchronization [req-2b08b920-1e84-460b-9377-81a6a27aeb1f req-c72db2e5-98b3-4996-9114-52cb4b393de2 tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1326.416983] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1326.417052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.417248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.417248] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.417551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.417619] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.417718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.417780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.417990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.418321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.418321] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.734467] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.734653] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.734893] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.735184] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.735437] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.735595] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.735708] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.735908] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.736067] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.736279] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1326.736386] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1326.736488] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1326.736590] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1326.736693] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1326.736792] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1326.736990] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1326.757945] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1326.758127] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1326.758232] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1326.758401] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.758694] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-c80f9732-4168-4aa6-bcca-d274b7ae3332 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.758856] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.758972] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.759294] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.759429] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80f9732-4168-4aa6-bcca-d274b7ae3332',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.920052] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.920052] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.920250] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.920345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.920432] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.920628] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.920722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.920784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.920929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.921042] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.921102] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 already deleted. [ 1326.921168] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.261753] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.261970] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.262168] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.262429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.262578] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.262732] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port c80f9732-4168-4aa6-bcca-d274b7ae3332 not found, creating... [ 1327.262993] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.263168] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.263281] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.263507] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.263668] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.264077] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.264261] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.264416] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.264635] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.264863] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.265112] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 is going to be created. [ 1327.291149] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.291425] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.291823] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.292110] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.292422] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.292696] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.016467] env[65469]: INFO networking_nsxv3.common.synchronization [req-2b08b920-1e84-460b-9377-81a6a27aeb1f req-dae231bf-ce49-4032-9bae-71356cf5478a service nova] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1328.016772] env[65469]: INFO networking_nsxv3.common.synchronization [req-2b08b920-1e84-460b-9377-81a6a27aeb1f req-dae231bf-ce49-4032-9bae-71356cf5478a service nova] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1328.016772] env[65469]: INFO networking_nsxv3.common.synchronization [req-2b08b920-1e84-460b-9377-81a6a27aeb1f req-dae231bf-ce49-4032-9bae-71356cf5478a service nova] Enqueued Resource ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 with Priority: HIGHEST for action port [ 1328.017306] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1328.017458] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1328.017544] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 with Priority: HIGHEST for action port [ 1328.017804] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.017923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.017990] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.018199] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.018282] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.019227] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.019289] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.019322] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.019482] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.019627] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.019718] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.019779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.019927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.020016] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.020198] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.021322] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c80f9732-4168-4aa6-bcca-d274b7ae3332 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.021473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.022522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.022629] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.022718] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80f9732-4168-4aa6-bcca-d274b7ae3332',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.525726] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.525726] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.525726] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.526373] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c80f9732-4168-4aa6-bcca-d274b7ae3332 with status ACTIVE [ 1328.526594] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.526716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.526780] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.526978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.527136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.527246] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.527339] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.527397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.527551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.527639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.527824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.527921] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.527986] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.528142] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.528226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.528324] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 is going to be updated. [ 1328.550803] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.551015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.551015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.551226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.551458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.551619] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.030028] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.532912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.533093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.533160] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.533367] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.533453] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.533548] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 is going to be created. [ 1329.559300] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.559497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.559497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.559712] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.559872] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.570526] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: UNINITIALIZED for 2s [ 1331.581989] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: SUCCESS [ 1331.582409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.582409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.582617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.582821] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.582948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.583029] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.583205] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.583290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.583385] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.583478] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.086524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.588697] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb30ec04-7782-4af7-b1ae-b6841e72d0b5: rpc.has_security_group_logging(os_id): False [ 1332.606731] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.606946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.606946] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.607213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.607310] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.607547] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.607668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.607734] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.607883] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.607961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.608057] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 is going to be created. [ 1332.669453] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.669701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.669701] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.669889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.670093] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.681131] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: IN_PROGRESS for 2s [ 1333.018443] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.018605] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1334.694411] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: SUCCESS [ 1334.694818] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.020226] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.020692] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.021121] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.021549] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.022657] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.023043] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.794536] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.794790] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.794927] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.795243] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.795505] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.795661] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.795779] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.796092] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.796220] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.796434] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1348.796547] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1348.796654] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1348.796759] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1348.796865] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1348.796970] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1348.797116] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1348.818110] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1348.818303] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1348.818436] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1348.818587] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-988" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.818894] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-528db453-711d-45aa-8edf-2ece09cf9f02 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.819087] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.819236] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.819511] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.819647] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528db453-711d-45aa-8edf-2ece09cf9f02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.322832] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.322832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.322832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.322832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.322832] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.322832] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.323849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.323849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.323849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.323849] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.323849] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.324182] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.324182] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.324287] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.324517] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.324517] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 528db453-711d-45aa-8edf-2ece09cf9f02 is going to be updated. [ 1349.345984] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.346204] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.346358] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.346637] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.346830] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.347063] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.038158] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbaa4a85-e82b-46f2-b9e6-95b6d3ec322c req-b33ca188-a94a-400c-bbdd-6c758fb5e522 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1350.038158] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbaa4a85-e82b-46f2-b9e6-95b6d3ec322c req-b33ca188-a94a-400c-bbdd-6c758fb5e522 service nova] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1350.038354] env[65469]: INFO networking_nsxv3.common.synchronization [req-bbaa4a85-e82b-46f2-b9e6-95b6d3ec322c req-b33ca188-a94a-400c-bbdd-6c758fb5e522 service nova] Enqueued Resource ID: 528db453-711d-45aa-8edf-2ece09cf9f02 with Priority: HIGHEST for action port [ 1350.038732] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_rules [ 1350.038879] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1350.038976] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 528db453-711d-45aa-8edf-2ece09cf9f02 with Priority: HIGHEST for action port [ 1350.039430] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.039555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.039631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.039887] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.039971] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.040808] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.040937] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.040977] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.041182] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.041325] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.041415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.041478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.041640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.041694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.042583] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.042853] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-528db453-711d-45aa-8edf-2ece09cf9f02 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.043146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.043146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.043279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.043309] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528db453-711d-45aa-8edf-2ece09cf9f02',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.545138] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.545546] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.545546] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.546833] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 528db453-711d-45aa-8edf-2ece09cf9f02 with status ACTIVE [ 1350.547053] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.547197] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.547267] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.547478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.547562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.547733] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.547821] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.547874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.548045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.548113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.548375] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.548375] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.548497] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.548620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.548620] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.548744] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 528db453-711d-45aa-8edf-2ece09cf9f02 is going to be updated. [ 1350.570454] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.570654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.570654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.570843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.571057] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.571141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-528db453-711d-45aa-8edf-2ece09cf9f02" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.051367] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.554124] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.554597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.554597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.554597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.554860] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.554860] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1351.584778] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.585032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.585146] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.585504] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.585673] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.595176] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1351.716684] env[65469]: INFO networking_nsxv3.common.synchronization [req-8d39b08b-387a-4b8f-95bb-19d705aa4e82 req-0d2e5370-3e46-4539-bf60-3d23230d293c tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1351.717396] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1351.717396] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.717396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.717396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.717747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.717747] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.717747] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.717904] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.717974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.718068] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.718163] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.220204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.220450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.220450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.220672] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.220761] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.220958] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.221070] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.221176] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.221319] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.221397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.221483] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1352.250884] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.251131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.251131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.251314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.251459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.260898] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1352.636957] env[65469]: INFO networking_nsxv3.common.synchronization [req-0e898bc7-7fe7-4645-b01a-a6da05045f9a req-67f93701-98ee-4fb6-8644-625df1e3d0eb tempest-AttachVolumeNegativeTest-500441052 tempest-AttachVolumeNegativeTest-500441052-project-member] Enqueued Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1352.637508] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be415275-bc89-4178-b92c-b8aef3d69eb5 with Priority: HIGHEST for action security_group_members [ 1352.637823] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-be415275-bc89-4178-b92c-b8aef3d69eb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.637959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.638041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.638380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.638535] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.638633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.638697] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.638845] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.638929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.639051] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be415275-bc89-4178-b92c-b8aef3d69eb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.141342] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.141535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.141597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.141814] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.171732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.172040] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.172254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.172254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.172452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.172531] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.172623] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 is going to be updated. [ 1353.220106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.220423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.220423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.220639] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.220749] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.230686] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: IN_PROGRESS for 2s [ 1353.605475] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1353.605588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.605768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.605980] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.606187] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.606314] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.606391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.606549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.606630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.606716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.606861] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.109256] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.271438] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1354.271703] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 deletion is rescheduled due to dependency. [ 1354.271831] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.612778] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 885e7f1b-e47b-4285-ab7d-029f48a54f6a: rpc.has_security_group_logging(os_id): False [ 1354.633347] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.633535] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.633589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.633965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.633965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.634210] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.634327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.634395] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.634554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.634635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.634724] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1354.694773] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.694929] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.695021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.695245] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.695400] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.710854] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1355.242181] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be415275-bc89-4178-b92c-b8aef3d69eb5 in Status: SUCCESS [ 1355.242539] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be415275-bc89-4178-b92c-b8aef3d69eb5 deletion is rescheduled due to dependency. [ 1355.242539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be415275-bc89-4178-b92c-b8aef3d69eb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.729428] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1356.729857] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.638627] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.638890] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.936401] env[65469]: INFO networking_nsxv3.common.synchronization [req-d339726c-f9d4-40e9-ad16-46728c855159 req-77f89e80-e985-4e71-8354-3d7da7ceefcb tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1358.937113] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1358.937280] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.937435] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.937476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.937661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.937810] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.937907] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.937968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.938137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.938224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.938315] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.441316] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.441512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.441512] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.441668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.441763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.441955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.442078] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.442124] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.442293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.442342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.442420] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1359.479577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.479819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.479819] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.479994] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.480164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.490944] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1359.714069] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.714069] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.714069] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.714348] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.714551] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.714711] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.714830] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.715111] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.715310] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.715492] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1359.715604] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1359.715709] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1359.716027] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1359.716027] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1359.716027] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1359.716194] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1359.735387] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1359.735591] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1359.735680] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1359.735857] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-27" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.736196] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-6fd915bd-9a7d-4f1b-b980-49b09654cf80 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.736376] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.736492] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.736834] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.736971] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd915bd-9a7d-4f1b-b980-49b09654cf80',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.239579] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.240037] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.240037] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.240479] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.240662] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.240834] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 6fd915bd-9a7d-4f1b-b980-49b09654cf80 not found, creating... [ 1360.241208] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.241429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.241570] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.241879] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.242059] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.242415] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.242639] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.242804] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.243058] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.243207] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.243348] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 6fd915bd-9a7d-4f1b-b980-49b09654cf80 is going to be created. [ 1360.273457] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.273692] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.273801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.274231] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.274476] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.274701] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.975018] env[65469]: INFO networking_nsxv3.common.synchronization [req-d339726c-f9d4-40e9-ad16-46728c855159 req-0fe04570-d041-4c22-a24e-842b87896962 service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 1360.975231] env[65469]: INFO networking_nsxv3.common.synchronization [req-d339726c-f9d4-40e9-ad16-46728c855159 req-0fe04570-d041-4c22-a24e-842b87896962 service nova] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1360.975378] env[65469]: INFO networking_nsxv3.common.synchronization [req-d339726c-f9d4-40e9-ad16-46728c855159 req-0fe04570-d041-4c22-a24e-842b87896962 service nova] Enqueued Resource ID: 6fd915bd-9a7d-4f1b-b980-49b09654cf80 with Priority: HIGHEST for action port [ 1360.975895] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_rules [ 1360.976048] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1360.976194] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd915bd-9a7d-4f1b-b980-49b09654cf80 with Priority: HIGHEST for action port [ 1360.976464] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.976588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.976745] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.976837] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.976962] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.977766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.977856] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.978051] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fd915bd-9a7d-4f1b-b980-49b09654cf80 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.978157] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.978216] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.978387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.978457] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd915bd-9a7d-4f1b-b980-49b09654cf80',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.480475] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.480913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.480913] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fd915bd-9a7d-4f1b-b980-49b09654cf80 with status ACTIVE [ 1361.481154] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.481293] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.481340] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.481555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.481647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.481881] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.482087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.482173] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.482382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.482456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.482661] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.482766] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.482836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.483187] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.483302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.483409] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fd915bd-9a7d-4f1b-b980-49b09654cf80 is going to be updated. [ 1361.507785] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.508034] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.508095] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.508391] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.508525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.508699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fd915bd-9a7d-4f1b-b980-49b09654cf80" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.509907] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1361.510116] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 deletion is rescheduled due to dependency. [ 1361.510249] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.510478] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.510779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.511061] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.511202] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.511271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.511477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.511645] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.511790] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.013899] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.516107] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.018577] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.018826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.018826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.019177] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.019280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.019376] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1363.048009] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.048587] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.048663] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.048870] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.049032] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.057261] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1365.069095] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1365.069459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.069459] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.070458] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.070458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.070458] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.573182] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.977439] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.977629] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1366.076197] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8608a4da-285d-4dc3-aa08-db64404925d5: rpc.has_security_group_logging(os_id): False [ 1366.097459] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.097640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.097681] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.097874] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.097956] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.098218] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.098368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.098368] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.098525] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.098598] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.098684] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1366.203049] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.203282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.203282] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.203494] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.203669] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.225173] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1367.452238] env[65469]: INFO networking_nsxv3.common.synchronization [req-6c29c96b-443e-4371-be4f-a5c32e3e0fa5 req-573bed17-e326-4626-865a-6b21f865b9e8 tempest-ServerActionsTestOtherB-931641744 tempest-ServerActionsTestOtherB-931641744-project-member] Enqueued Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1367.453086] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a with Priority: HIGHEST for action security_group_members [ 1367.453504] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-885e7f1b-e47b-4285-ab7d-029f48a54f6a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.454331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.454331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.454331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.454331] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.454542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.454542] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.454656] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.454774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.454884] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('885e7f1b-e47b-4285-ab7d-029f48a54f6a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.957168] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.957451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.957536] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.957769] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.957869] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.958370] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.958370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.958370] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.958632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.958632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.958632] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a is going to be updated. [ 1367.988329] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.988487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.988544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.988779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.988927] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.998014] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: IN_PROGRESS for 2s [ 1368.239392] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1368.239751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.008547] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a in Status: SUCCESS [ 1370.008920] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 885e7f1b-e47b-4285-ab7d-029f48a54f6a deletion is rescheduled due to dependency. [ 1370.008920] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-885e7f1b-e47b-4285-ab7d-029f48a54f6a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.454270] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.454665] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.455527] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.456285] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.457387] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.457772] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.458577] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.459025] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.460049] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.460427] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.461158] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.461562] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.057504] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.057865] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.057865] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.058099] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.058349] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.058531] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.058652] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.058868] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.059022] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.059238] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1402.059348] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1402.059452] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1402.059572] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1402.059703] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1402.059811] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1402.059939] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1402.079656] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1402.079817] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1402.079943] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1402.080131] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-623" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.080434] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-c80f9732-4168-4aa6-bcca-d274b7ae3332 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.080603] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.080720] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.080973] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.081122] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80f9732-4168-4aa6-bcca-d274b7ae3332',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.462669] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.462858] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.584042] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.584339] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.584518] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.584801] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.584952] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.585248] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.585418] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.585549] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.585762] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.585896] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.586200] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.586353] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.586466] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.586670] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.586822] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.586970] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 is going to be updated. [ 1402.610121] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.610351] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.610474] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.610750] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.610945] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.611193] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.294964] env[65469]: INFO networking_nsxv3.common.synchronization [req-e8378038-5209-4c74-bc3b-3f2c7ba6e0aa req-68c590da-619d-47d5-a636-947ede4dbc8b service nova] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1403.295331] env[65469]: INFO networking_nsxv3.common.synchronization [req-e8378038-5209-4c74-bc3b-3f2c7ba6e0aa req-68c590da-619d-47d5-a636-947ede4dbc8b service nova] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1403.295331] env[65469]: INFO networking_nsxv3.common.synchronization [req-e8378038-5209-4c74-bc3b-3f2c7ba6e0aa req-68c590da-619d-47d5-a636-947ede4dbc8b service nova] Enqueued Resource ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 with Priority: HIGHEST for action port [ 1403.295901] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_rules [ 1403.296212] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1403.296350] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 with Priority: HIGHEST for action port [ 1403.296715] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.296773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.296827] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.297091] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.297259] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.299143] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.299143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.299143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.299332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.299474] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.299577] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.299644] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.299791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.299881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.299975] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.300789] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c80f9732-4168-4aa6-bcca-d274b7ae3332 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.301087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.301209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.301447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.301536] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80f9732-4168-4aa6-bcca-d274b7ae3332',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.803676] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.804736] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.804842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.805011] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c80f9732-4168-4aa6-bcca-d274b7ae3332 with status ACTIVE [ 1403.805174] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.805278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.805341] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.805549] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.805647] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.805815] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.805908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.805965] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.806136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.806213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.806390] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.806502] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.806556] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.806670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.806771] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.806853] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c80f9732-4168-4aa6-bcca-d274b7ae3332 is going to be updated. [ 1403.830414] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.830635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.830635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.830826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.830962] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.831144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c80f9732-4168-4aa6-bcca-d274b7ae3332" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.308995] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.812691] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.812691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.812691] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.812998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.812998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.812998] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 is going to be updated. [ 1404.847666] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.847894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.848077] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.848321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.848550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.859802] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: IN_PROGRESS for 2s [ 1406.871085] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: SUCCESS [ 1406.871475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.871475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.871703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.871893] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.872018] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.872087] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.872241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.872321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.872436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.872529] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.374906] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.878088] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb30ec04-7782-4af7-b1ae-b6841e72d0b5: rpc.has_security_group_logging(os_id): False [ 1407.896629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.896882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.896882] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.897212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.897477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.897559] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.897692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.897794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.897985] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.898195] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.898195] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 is going to be updated. [ 1407.974540] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.974720] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.974811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.975059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.975214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.988548] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: IN_PROGRESS for 2s [ 1408.297366] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.297601] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1410.003544] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: SUCCESS [ 1410.003889] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.299046] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.299476] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.300724] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.301334] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.833203] env[65469]: INFO networking_nsxv3.common.synchronization [req-0bd8609a-0f09-4a21-a2ca-eadf72f7f5e1 req-ed140312-1f3b-4b4e-a543-aa536e04627c tempest-ServerActionsTestJSON-1188658768 tempest-ServerActionsTestJSON-1188658768-project-member] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1421.833569] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGHEST for action security_group_members [ 1421.833732] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.833853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.833933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.834126] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.834293] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.835030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.835030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.835030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.835030] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.835030] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.337358] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.337358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.337358] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.337655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.337772] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.337996] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.338144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.338229] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.338394] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.338476] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.338563] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be updated. [ 1422.366571] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.366793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.366793] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.366959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.367116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.376010] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: IN_PROGRESS for 2s [ 1424.394888] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8608a4da-285d-4dc3-aa08-db64404925d5 in Status: SUCCESS [ 1424.395345] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 deletion is rescheduled due to dependency. [ 1424.395345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.834617] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.834617] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.045448] env[65469]: INFO networking_nsxv3.common.synchronization [None req-7190e6b6-e057-4d24-a21d-092c0dd8e082 None None] Enqueued Resource ID: 11ecb36f-68af-4870-9a29-55b0a9f76505 with Priority: HIGHEST for action port [ 1430.045954] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ecb36f-68af-4870-9a29-55b0a9f76505 with Priority: HIGHEST for action port [ 1430.046490] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ecb36f-68af-4870-9a29-55b0a9f76505 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.046614] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ecb36f-68af-4870-9a29-55b0a9f76505" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.046679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ecb36f-68af-4870-9a29-55b0a9f76505" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.046932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ecb36f-68af-4870-9a29-55b0a9f76505" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.048012] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ecb36f-68af-4870-9a29-55b0a9f76505',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.550534] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11ecb36f-68af-4870-9a29-55b0a9f76505 [ 1430.550801] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.550940] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.551017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.551258] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.551350] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.551445] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11ecb36f-68af-4870-9a29-55b0a9f76505 already deleted. [ 1430.551518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ecb36f-68af-4870-9a29-55b0a9f76505" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.643422] env[65469]: INFO networking_nsxv3.common.synchronization [None req-8bb0c9a5-3456-433c-938a-16931808b8f6 tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1430.644025] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1430.644313] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.644436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.644505] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.644810] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.644925] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.732917] env[65469]: INFO networking_nsxv3.common.synchronization [None req-a1c94ee2-8ec7-467b-8123-91d71f277328 tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1430.733459] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1430.733770] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.733960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.167916] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.168268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.168268] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.168402] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.168467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.168561] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 already deleted. [ 1431.168643] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.168795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.168944] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.169036] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.689492] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.689694] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.689748] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.689928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.689998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.690106] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 already deleted. [ 1431.690224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.245279] env[65469]: INFO networking_nsxv3.common.synchronization [None req-d5191e10-7db7-4bce-9ced-57ae9a3761e9 None None] Enqueued Resource ID: c33ecd18-79d3-4577-abd2-32cf3c18449b with Priority: HIGHEST for action port [ 1432.245751] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33ecd18-79d3-4577-abd2-32cf3c18449b with Priority: HIGHEST for action port [ 1432.246065] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33ecd18-79d3-4577-abd2-32cf3c18449b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.246204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33ecd18-79d3-4577-abd2-32cf3c18449b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.246272] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33ecd18-79d3-4577-abd2-32cf3c18449b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.246522] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33ecd18-79d3-4577-abd2-32cf3c18449b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.246604] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33ecd18-79d3-4577-abd2-32cf3c18449b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.749059] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c33ecd18-79d3-4577-abd2-32cf3c18449b [ 1432.749424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.749618] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.749725] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.750046] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.750189] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.750336] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c33ecd18-79d3-4577-abd2-32cf3c18449b already deleted. [ 1432.750485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33ecd18-79d3-4577-abd2-32cf3c18449b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.109534] env[65469]: INFO networking_nsxv3.common.synchronization [req-c13c4fde-4b73-45b0-a8c6-150b18d08b5d req-8082a707-ef7b-4c98-8c76-a14eb650c16c tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1436.110041] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1436.110346] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.110465] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.110582] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.110826] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.110981] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.112123] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.112204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.112387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.112803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.112803] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.368102] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock network-368 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.368315] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.368443] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.368768] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.369096] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.369274] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.369397] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.369615] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.369760] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.369973] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1436.370100] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1436.370209] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1436.370317] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1436.370426] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1436.370529] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1436.370657] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1436.393679] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1436.393852] env[65469]: DEBUG dogpile.cache.region [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1436.393980] env[65469]: DEBUG dogpile.lock [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1436.394184] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.394489] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.394659] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.394811] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.395162] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.395303] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.614318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.614553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.614553] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.614811] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.614893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.615101] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.615203] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.615260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.615416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.615489] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.615574] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 already deleted. [ 1436.615655] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.897875] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.898165] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.898244] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.898503] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.898660] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.898811] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Segment Port 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 not found, creating... [ 1436.899113] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.899264] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.899383] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.899605] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.899739] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.900031] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.900206] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.900296] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.900509] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.900613] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.900748] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Resource: SegmentPort with ID: 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 is going to be created. [ 1436.922193] env[65469]: DEBUG networking_nsxv3.common.locking [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.922409] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.922534] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.922891] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.923136] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.923361] env[65469]: DEBUG oslo_concurrency.lockutils [None req-a95369a2-a155-4084-b875-fda0249147b1 None None] Releasing lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.615978] env[65469]: INFO networking_nsxv3.common.synchronization [req-c13c4fde-4b73-45b0-a8c6-150b18d08b5d req-15ddada8-cc6c-458b-bc10-0edceb9225d1 service nova] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1437.616410] env[65469]: INFO networking_nsxv3.common.synchronization [req-c13c4fde-4b73-45b0-a8c6-150b18d08b5d req-15ddada8-cc6c-458b-bc10-0edceb9225d1 service nova] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1437.616410] env[65469]: INFO networking_nsxv3.common.synchronization [req-c13c4fde-4b73-45b0-a8c6-150b18d08b5d req-15ddada8-cc6c-458b-bc10-0edceb9225d1 service nova] Enqueued Resource ID: 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 with Priority: HIGHEST for action port [ 1437.616752] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_rules [ 1437.616887] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1437.616984] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 with Priority: HIGHEST for action port [ 1437.617277] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.617409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.617446] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.617636] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.617713] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.618604] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.618721] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.618802] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.618955] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.619106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.619290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.619290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.619414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.619467] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.619587] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.620598] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.620677] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.620716] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.620863] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.620944] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.122845] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.123102] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.123154] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.124427] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 with status ACTIVE [ 1438.124607] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.124773] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.124843] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.125065] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.125158] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.125809] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.125809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.125809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.125809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.125809] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.126106] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.126106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.126106] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.126214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.126214] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.126321] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0 is going to be updated. [ 1438.146883] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.147107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.147107] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.147290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.147426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.147755] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-906a6a7b-6929-4b60-82d7-c7e7cd9fa6c0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.628309] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.130766] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.130928] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.131009] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.131240] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.131329] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.131427] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 is going to be created. [ 1439.156286] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.156434] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.156490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.156692] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.156853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.166748] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: UNINITIALIZED for 2s [ 1441.178624] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: SUCCESS [ 1441.179035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.179221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.179537] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.179829] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.179998] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.180111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.180332] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.180451] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.180576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.180707] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.684000] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.186551] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24413c71-5461-4754-8f77-a3fb3e5ebfb5: rpc.has_security_group_logging(os_id): False [ 1442.204436] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.204631] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.204679] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.204950] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.205100] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.205424] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.205562] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.205654] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.205893] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.206040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.206217] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 is going to be created. [ 1442.262648] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.262951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.262951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.263166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.263345] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.273014] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: IN_PROGRESS for 2s [ 1442.618065] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.618285] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1444.285157] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: SUCCESS [ 1444.285600] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.619580] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.619580] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.621065] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.621065] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.969870] env[65469]: INFO networking_nsxv3.common.synchronization [req-171b0ccf-b453-42a4-b010-ce5f644c5df0 req-fb4651c1-1394-42e1-8ffd-a74c076a578c tempest-AttachVolumeShelveTestJSON-44099528 tempest-AttachVolumeShelveTestJSON-44099528-project-member] Enqueued Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1455.970528] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 with Priority: HIGHEST for action security_group_members [ 1455.970972] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.971136] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.971224] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.971523] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.971687] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.971790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.971853] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.972022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.972109] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.972200] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb30ec04-7782-4af7-b1ae-b6841e72d0b5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.474827] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.475117] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.475433] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.475684] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.475971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.476318] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.476449] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.476511] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.476779] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.476866] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.476992] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 is going to be updated. [ 1456.507233] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.507475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.507475] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.507632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.507803] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.516155] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: IN_PROGRESS for 2s [ 1458.528934] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 in Status: SUCCESS [ 1458.529384] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb30ec04-7782-4af7-b1ae-b6841e72d0b5 deletion is rescheduled due to dependency. [ 1458.529384] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb30ec04-7782-4af7-b1ae-b6841e72d0b5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.972140] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.972523] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.974130] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.974431] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.975704] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.976119] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.977283] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.977654] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.978114] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.978524] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.979652] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.980057] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.980786] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.981174] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.030208] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1495.030689] env[65469]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a96535d2-2a61-45e0-8467-861b2b4c19cf None None] NSXv3 Agent Agent loop - iteration:4 started [ 1495.982149] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.982381] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.983403] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.983787] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.984355] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.984800] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.986156] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.986609] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.987374] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.987776] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.988614] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.989122] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.993151] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.993576] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.995244] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.995688] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.996192] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.996413] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.975816] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.976285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.976285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.976285] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.976412] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.479524] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.982521] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.485521] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1539.485803] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1540.225824] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.226255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.226255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.226255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.239524] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1540.240417] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.241387] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1540.283774] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.284075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.284075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.284253] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.297067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.297853] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1540.297935] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.298058] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1540.332200] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.332414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.332414] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.332617] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.333427] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.333620] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1540.411791] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.412040] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.412110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.412270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.412581] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.412862] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1540.493974] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.494140] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.494210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.494416] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.494729] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.495041] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 1540.495138] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'24413c71-5461-4754-8f77-a3fb3e5ebfb5', '93250c38-ef03-4516-b959-0aa8baeef74a', 'b309be15-6460-49da-bd48-e95c49f1421b', 'b72348dc-32e6-4663-85f1-f411e222a7a4', '55971d60-1eae-4db8-bf19-99bbbc18a8b6', 'fb6e69ce-aa18-43cb-be60-af4e37502a7a', '5bde506b-06fa-4939-b031-63dc38218dcc', '92bf433d-c39b-4344-960c-b8e0607c3036', '8c49bdcf-f8e3-4883-b509-795a54e2f950', '0e0e254f-6737-4701-b8b1-b6906deeb63f', '641bf348-fb8f-499f-a944-4cb315e55733', '5faeab0c-fd4f-463f-b917-048fa4f0ebd1', 'f1fe9c7b-391a-4964-94bd-fd69c7fb232c', '7663bbf6-b391-494e-9a60-db9d723b0635', 'ab3db8e0-1f52-4d95-9b58-4be9adf31de9', '3ad20fef-905e-4efe-bdf9-75c98decc63b', '5863af48-2574-424a-a51b-dcfeb0d1a63d', '8608a4da-285d-4dc3-aa08-db64404925d5', '470f3367-e1b6-4e76-8701-774a6b0e92ae', '93ec76a2-ebab-4757-a221-a85a6ae3b333', '2f4f7ec7-5508-45fa-9dca-52ca3bb66953', '885e7f1b-e47b-4285-ab7d-029f48a54f6a', '2d3a53e0-bc08-4699-b179-a2a446524a23', '1222eeb9-9dbe-496c-9f03-31010145cde2', 'bb30ec04-7782-4af7-b1ae-b6841e72d0b5', 'aa96ab4a-8a16-4875-8013-1f1b9504c258', 'fd6b3522-babc-4977-91f4-6a81f2f59e88', 'be415275-bc89-4178-b92c-b8aef3d69eb5', '1f756a88-e1c6-407c-9a54-9002d0c269ee', 'dac16e76-d38a-4051-af09-b9b6e58acda0'} {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.495236] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1540.515384] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.515597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.515597] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.515879] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.516015] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.516102] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1540.516175] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.516240] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1540.598284] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.598470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.598470] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.598708] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.599978] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.600262] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1540.600342] env[65469]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65469) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.600417] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1540.600482] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1540.600557] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 1540.600638] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGH for action security_group_rules [ 1540.600720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGH for action security_group_rules [ 1540.600791] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGH for action security_group_rules [ 1540.600855] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGH for action security_group_rules [ 1540.600917] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGH for action security_group_rules [ 1540.600978] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGH for action security_group_rules [ 1540.601051] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGH for action security_group_rules [ 1540.601112] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGH for action security_group_rules [ 1540.601172] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGH for action security_group_rules [ 1540.601233] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGH for action security_group_rules [ 1540.601293] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGH for action security_group_rules [ 1540.601353] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGH for action security_group_rules [ 1540.601413] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGH for action security_group_rules [ 1540.601476] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGH for action security_group_rules [ 1540.601536] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGH for action security_group_rules [ 1540.601597] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGH for action security_group_rules [ 1540.601659] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGH for action security_group_rules [ 1540.601720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1540.601782] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGH for action security_group_rules [ 1540.601843] env[65469]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGH for action security_group_rules [ 1540.601934] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.998163] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.998389] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1540.998441] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGH for action security_group_rules [ 1540.998570] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b309be15-6460-49da-bd48-e95c49f1421b with Priority: HIGH for action security_group_rules [ 1540.998693] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde506b-06fa-4939-b031-63dc38218dcc with Priority: HIGH for action security_group_rules [ 1540.998829] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 with Priority: HIGH for action security_group_rules [ 1540.998977] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 with Priority: HIGH for action security_group_rules [ 1540.999096] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae with Priority: HIGH for action security_group_rules [ 1540.999206] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8608a4da-285d-4dc3-aa08-db64404925d5 with Priority: HIGH for action security_group_rules [ 1540.999299] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d with Priority: HIGH for action security_group_rules [ 1540.999388] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7663bbf6-b391-494e-9a60-db9d723b0635 with Priority: HIGH for action security_group_rules [ 1540.999490] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b with Priority: HIGH for action security_group_rules [ 1540.999600] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c with Priority: HIGH for action security_group_rules [ 1540.999695] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 with Priority: HIGH for action security_group_rules [ 1540.999837] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 641bf348-fb8f-499f-a944-4cb315e55733 with Priority: HIGH for action security_group_rules [ 1540.999973] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f with Priority: HIGH for action security_group_rules [ 1541.000097] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 with Priority: HIGH for action security_group_rules [ 1541.000202] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a with Priority: HIGH for action security_group_rules [ 1541.000293] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bf433d-c39b-4344-960c-b8e0607c3036 with Priority: HIGH for action security_group_rules [ 1541.000394] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 with Priority: HIGH for action security_group_rules [ 1541.000489] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93250c38-ef03-4516-b959-0aa8baeef74a with Priority: HIGH for action security_group_rules [ 1541.000579] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72348dc-32e6-4663-85f1-f411e222a7a4 with Priority: HIGH for action security_group_rules [ 1541.000955] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.001144] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.001210] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.001485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.001586] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.002697] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b309be15-6460-49da-bd48-e95c49f1421b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.002840] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.002926] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.003137] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.003220] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b309be15-6460-49da-bd48-e95c49f1421b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.004115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bde506b-06fa-4939-b031-63dc38218dcc taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.004235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.004382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.004550] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.004636] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bde506b-06fa-4939-b031-63dc38218dcc',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.006143] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.006143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.006143] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.006296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.006359] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3db8e0-1f52-4d95-9b58-4be9adf31de9',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.007110] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ec76a2-ebab-4757-a221-a85a6ae3b333 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.007222] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.007290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.007444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.007514] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ec76a2-ebab-4757-a221-a85a6ae3b333',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.008229] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-470f3367-e1b6-4e76-8701-774a6b0e92ae taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.008396] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.008503] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.009037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.009037] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('470f3367-e1b6-4e76-8701-774a6b0e92ae',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.009456] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8608a4da-285d-4dc3-aa08-db64404925d5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.009559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.009625] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.009774] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.009856] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8608a4da-285d-4dc3-aa08-db64404925d5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.010526] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5863af48-2574-424a-a51b-dcfeb0d1a63d taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.011110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.011110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.011110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.011110] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5863af48-2574-424a-a51b-dcfeb0d1a63d',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.011695] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7663bbf6-b391-494e-9a60-db9d723b0635 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.011825] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.011895] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.012049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.012635] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7663bbf6-b391-494e-9a60-db9d723b0635',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.012781] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ad20fef-905e-4efe-bdf9-75c98decc63b taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.012888] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.012953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.013113] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.013621] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ad20fef-905e-4efe-bdf9-75c98decc63b',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.013817] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.013922] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.013987] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.014159] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.014243] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1fe9c7b-391a-4964-94bd-fd69c7fb232c',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.015125] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.015261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.015261] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.015413] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.015478] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5faeab0c-fd4f-463f-b917-048fa4f0ebd1',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.016336] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-641bf348-fb8f-499f-a944-4cb315e55733 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.016473] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.016539] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.016698] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.016799] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('641bf348-fb8f-499f-a944-4cb315e55733',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.017462] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0e254f-6737-4701-b8b1-b6906deeb63f taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.017588] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.017632] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.017763] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.017832] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0e254f-6737-4701-b8b1-b6906deeb63f',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.018566] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c49bdcf-f8e3-4883-b509-795a54e2f950 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.018675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.018739] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.019090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.019090] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c49bdcf-f8e3-4883-b509-795a54e2f950',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.021664] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.021813] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.021864] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.021999] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.022254] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb6e69ce-aa18-43cb-be60-af4e37502a7a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.022817] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92bf433d-c39b-4344-960c-b8e0607c3036 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.022925] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.022968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.023131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.023238] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92bf433d-c39b-4344-960c-b8e0607c3036',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.023912] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.024037] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.024097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.024255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.024316] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55971d60-1eae-4db8-bf19-99bbbc18a8b6',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.025067] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93250c38-ef03-4516-b959-0aa8baeef74a taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.025164] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.025234] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.025380] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.025451] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93250c38-ef03-4516-b959-0aa8baeef74a',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.026129] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b72348dc-32e6-4663-85f1-f411e222a7a4 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.026235] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.026300] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.026444] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.026512] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b72348dc-32e6-4663-85f1-f411e222a7a4',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.050530] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.050675] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.050722] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.050923] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.073045] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.073241] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3db8e0-1f52-4d95-9b58-4be9adf31de9 is going to be deleted. [ 1541.120680] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.120941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.120941] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.121062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.121162] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.121284] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3db8e0-1f52-4d95-9b58-4be9adf31de9" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.543460] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.543795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.543795] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.543924] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.544089] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.544209] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.544274] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.544426] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.544510] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.544593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.544678] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.580259] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.580462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.580462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.580670] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.594265] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.594422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.604937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.605122] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.606048] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.606166] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.606941] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.607058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.607735] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.607829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.608629] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.608768] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.609463] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.609561] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.610236] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.610331] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.611021] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.611147] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.611848] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.611964] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.612546] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.613118] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.613221] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.613959] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.614472] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.614571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.615532] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.615970] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.616076] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.616650] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.617056] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.617150] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.617709] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.618134] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.618226] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.618782] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.619169] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.619262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.619817] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.620209] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.620296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.621232] env[65469]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1541.621635] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.621745] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 641bf348-fb8f-499f-a944-4cb315e55733 is going to be deleted. [ 1541.622641] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.622848] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.641873] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.642036] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 470f3367-e1b6-4e76-8701-774a6b0e92ae is going to be deleted. [ 1541.642865] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.643105] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.661799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.661939] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bde506b-06fa-4939-b031-63dc38218dcc is going to be deleted. [ 1541.662823] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.663044] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.681589] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.681723] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ec76a2-ebab-4757-a221-a85a6ae3b333 is going to be deleted. [ 1541.682646] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.682894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.700499] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.700648] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.702784] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.702933] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.704067] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.704200] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7663bbf6-b391-494e-9a60-db9d723b0635 is going to be deleted. [ 1541.705013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.705315] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.722551] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.722691] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb6e69ce-aa18-43cb-be60-af4e37502a7a is going to be deleted. [ 1541.723559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.723775] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.728393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.728532] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.741951] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.742103] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8608a4da-285d-4dc3-aa08-db64404925d5 is going to be deleted. [ 1541.742983] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.743213] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.746296] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.746458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.774016] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.774254] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.784783] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.784993] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ad20fef-905e-4efe-bdf9-75c98decc63b is going to be deleted. [ 1541.786317] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.786661] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.789482] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.789668] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.867640] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.867838] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c49bdcf-f8e3-4883-b509-795a54e2f950 is going to be deleted. [ 1541.868730] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.868959] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.904793] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.905035] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.964376] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.964593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.969932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.970119] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92bf433d-c39b-4344-960c-b8e0607c3036 is going to be deleted. [ 1541.971059] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.971290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.007204] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.007415] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.009703] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.009823] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5863af48-2574-424a-a51b-dcfeb0d1a63d is going to be deleted. [ 1542.010744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.010969] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.058212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.058398] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0e254f-6737-4701-b8b1-b6906deeb63f is going to be deleted. [ 1542.059426] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.060313] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.060538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.086840] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.087085] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.114485] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.114762] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b309be15-6460-49da-bd48-e95c49f1421b is going to be deleted. [ 1542.115594] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.115892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.156454] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.156685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.159154] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.159280] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.168554] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.168688] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55971d60-1eae-4db8-bf19-99bbbc18a8b6 is going to be deleted. [ 1542.169590] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.169836] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.191021] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.191208] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b72348dc-32e6-4663-85f1-f411e222a7a4 is going to be deleted. [ 1542.192089] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.192306] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.232665] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.232852] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1fe9c7b-391a-4964-94bd-fd69c7fb232c is going to be deleted. [ 1542.233746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.233979] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.264970] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.265208] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.285456] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.285646] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93250c38-ef03-4516-b959-0aa8baeef74a is going to be deleted. [ 1542.286571] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.286798] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.328927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.329172] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.332355] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.332490] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.346028] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.346198] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5faeab0c-fd4f-463f-b917-048fa4f0ebd1 is going to be deleted. [ 1542.347154] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.347382] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.347479] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.347607] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-641bf348-fb8f-499f-a944-4cb315e55733" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.347767] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.347932] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.348022] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.348141] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-470f3367-e1b6-4e76-8701-774a6b0e92ae" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.348685] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.348894] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.348958] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.349090] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bde506b-06fa-4939-b031-63dc38218dcc" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.349225] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.349369] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.349445] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.349560] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ec76a2-ebab-4757-a221-a85a6ae3b333" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.349696] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.349842] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.349916] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.350041] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7663bbf6-b391-494e-9a60-db9d723b0635" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.350183] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.350327] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.350401] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.350513] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb6e69ce-aa18-43cb-be60-af4e37502a7a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.350642] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.350784] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.350862] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.350975] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8608a4da-285d-4dc3-aa08-db64404925d5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.351118] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.351260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.351336] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.351450] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ad20fef-905e-4efe-bdf9-75c98decc63b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.351576] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.351714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.351789] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.351891] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c49bdcf-f8e3-4883-b509-795a54e2f950" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.352072] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.352242] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.352321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.352452] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92bf433d-c39b-4344-960c-b8e0607c3036" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.352584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.352724] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.352799] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.352910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5863af48-2574-424a-a51b-dcfeb0d1a63d" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.353049] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.353191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.353262] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.353363] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0e254f-6737-4701-b8b1-b6906deeb63f" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.353487] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.353622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.353707] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.353829] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b309be15-6460-49da-bd48-e95c49f1421b" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.353961] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.354116] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.354188] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.354296] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55971d60-1eae-4db8-bf19-99bbbc18a8b6" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.354423] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.354559] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.354630] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.354732] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b72348dc-32e6-4663-85f1-f411e222a7a4" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.358225] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.358378] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.358425] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.358555] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.358633] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.358743] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1fe9c7b-391a-4964-94bd-fd69c7fb232c" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.427581] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.427790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.427790] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.427948] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.428058] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.428181] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93250c38-ef03-4516-b959-0aa8baeef74a" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.462487] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.462702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.462702] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.462901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.462993] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.463128] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5faeab0c-fd4f-463f-b917-048fa4f0ebd1" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.562782] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24413c71-5461-4754-8f77-a3fb3e5ebfb5: rpc.has_security_group_logging(os_id): False [ 1542.594551] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.594791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.594791] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.594971] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.614953] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.615339] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.615527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.615527] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.615760] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.615854] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.615915] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 is going to be updated. [ 1542.678859] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.679111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.679111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.679244] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.679387] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.693450] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: IN_PROGRESS for 2s [ 1544.706882] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: SUCCESS [ 1544.707292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.002420] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.002873] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.003692] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.004231] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.004782] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.005159] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.006072] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.006072] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.007075] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.007537] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.008858] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.009277] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.010713] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.011094] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.012059] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.012059] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.729146] env[65469]: INFO networking_nsxv3.common.synchronization [req-a8e56edf-7c24-454d-9ec3-e2063af72cde req-3ad2080a-a7e6-4eea-80c1-08b01e9be538 tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1584.729717] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 with Priority: HIGHEST for action security_group_members [ 1584.730080] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-24413c71-5461-4754-8f77-a3fb3e5ebfb5 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.730237] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.730499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.730499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.730656] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.730746] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.730806] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.730942] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.731055] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.731155] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24413c71-5461-4754-8f77-a3fb3e5ebfb5',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.233199] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.233447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.233593] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.233876] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.234036] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.234281] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.234422] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.234499] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.234744] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.234881] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.235042] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 is going to be updated. [ 1585.270363] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.270606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.270606] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.270794] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.270935] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.280300] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: IN_PROGRESS for 2s [ 1587.291736] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 in Status: SUCCESS [ 1587.292153] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24413c71-5461-4754-8f77-a3fb3e5ebfb5 deletion is rescheduled due to dependency. [ 1587.292153] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24413c71-5461-4754-8f77-a3fb3e5ebfb5" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.398680] env[65469]: INFO networking_nsxv3.common.synchronization [None req-3c46cd07-ad7a-4feb-b8e2-524d687ca85e tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1589.399093] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1589.399406] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.399529] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.399596] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.399852] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.399933] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.475437] env[65469]: INFO networking_nsxv3.common.synchronization [None req-712f1f2b-5f11-4943-8bbe-d229874f787f tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1589.476142] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1589.478429] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.478545] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.921533] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.921714] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.921788] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.922013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.922110] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.922210] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 already deleted. [ 1589.922302] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.922458] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.922611] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.922740] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.446588] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.446911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.446911] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.447014] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.447097] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.447190] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 already deleted. [ 1590.447270] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.476992] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.477352] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.814044] env[65469]: INFO networking_nsxv3.common.synchronization [req-ba09162b-3c2f-4fd4-8a65-39fa1754481e req-65b2b07c-f896-40e6-84cf-72f9c4ce1333 tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1594.814615] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1594.814927] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.815060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.815131] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.815371] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.815523] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.815622] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.815680] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.815839] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.815960] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.816041] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.075147] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock network-368 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.075429] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.075610] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.075957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.076338] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.076560] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.076718] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.077047] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.077293] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.077588] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1595.077742] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] NeedRegenerationException {{(pid=65469) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1595.077894] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] no value, waiting for create lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1595.078062] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] value creation lock acquired {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1595.078214] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] No value present for key: 'zone-id' {{(pid=65469) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1595.078359] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Calling creation function for not-yet-present value {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1595.078534] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1595.102570] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1595.102816] env[65469]: DEBUG dogpile.cache.region [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65469) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1595.102980] env[65469]: DEBUG dogpile.lock [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Released creation lock {{(pid=65469) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1595.103255] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "network-368" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.103616] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock port-448a44a1-100d-4506-ba12-60939c64faa0 taken with stack trace [, , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.103857] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.104059] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.104415] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.104586] env[65469]: DEBUG networking_nsxv3.api.rpc [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448a44a1-100d-4506-ba12-60939c64faa0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.318018] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.318233] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.318278] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.318477] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.318624] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.318802] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.318917] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.318967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.319133] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.319212] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.319304] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 already deleted. [ 1595.319389] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.607370] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.607741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.607741] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.607987] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.608150] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.608302] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Segment Port 448a44a1-100d-4506-ba12-60939c64faa0 not found, creating... [ 1595.608563] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.608957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.608957] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.609083] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.609176] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.609475] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.609905] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.609905] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.610046] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.610098] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.610231] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Resource: SegmentPort with ID: 448a44a1-100d-4506-ba12-60939c64faa0 is going to be created. [ 1595.630528] env[65469]: DEBUG networking_nsxv3.common.locking [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.630779] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.630850] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.631117] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.631350] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.631638] env[65469]: DEBUG oslo_concurrency.lockutils [None req-eaa048ab-783c-4440-a6a0-453b1b31bd52 None None] Releasing lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.316656] env[65469]: INFO networking_nsxv3.common.synchronization [req-ba09162b-3c2f-4fd4-8a65-39fa1754481e req-ec384485-35b6-436a-a40b-3940acf3a2d7 service nova] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1596.316823] env[65469]: INFO networking_nsxv3.common.synchronization [req-ba09162b-3c2f-4fd4-8a65-39fa1754481e req-ec384485-35b6-436a-a40b-3940acf3a2d7 service nova] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1596.316966] env[65469]: INFO networking_nsxv3.common.synchronization [req-ba09162b-3c2f-4fd4-8a65-39fa1754481e req-ec384485-35b6-436a-a40b-3940acf3a2d7 service nova] Enqueued Resource ID: 448a44a1-100d-4506-ba12-60939c64faa0 with Priority: HIGHEST for action port [ 1596.317515] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_rules [ 1596.317657] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1596.317754] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a44a1-100d-4506-ba12-60939c64faa0 with Priority: HIGHEST for action port [ 1596.318097] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.318178] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.318241] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.318518] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.318518] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.319303] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.319409] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.319472] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.319634] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.319769] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.319855] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.319910] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.320062] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.320139] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.320227] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.321353] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock port-448a44a1-100d-4506-ba12-60939c64faa0 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.321353] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.321496] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.321544] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.321599] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448a44a1-100d-4506-ba12-60939c64faa0',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.823420] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.824507] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.824667] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.824791] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 448a44a1-100d-4506-ba12-60939c64faa0 with status ACTIVE [ 1596.824937] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.825075] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.825111] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.825311] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.825397] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.825564] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.825657] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.825715] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.825892] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.825974] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.826190] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.826292] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.826342] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.826484] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.826557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.826641] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 448a44a1-100d-4506-ba12-60939c64faa0 is going to be updated. [ 1596.847393] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.847613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.847613] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.847792] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.847913] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.848084] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-448a44a1-100d-4506-ba12-60939c64faa0" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.328801] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.830865] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.831215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.831215] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.831290] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.831407] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.831467] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 is going to be created. [ 1597.855411] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.855584] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.855627] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.855815] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.855968] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.866509] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: UNINITIALIZED for 2s [ 1599.877119] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: SUCCESS [ 1599.877557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.877557] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.877751] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.877933] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.878060] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.878127] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.878279] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.878362] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.878447] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.878537] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.381097] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.883160] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a12695f-3c23-4690-aae0-abd23780e464: rpc.has_security_group_logging(os_id): False [ 1600.902103] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.902298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.902298] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.902486] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.902573] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.902813] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.902908] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.902967] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.903191] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.903271] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.903305] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 is going to be created. [ 1600.956337] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.956564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.956564] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.956817] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.957013] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.966818] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: IN_PROGRESS for 2s [ 1601.318980] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.318980] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1602.980033] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: SUCCESS [ 1602.980464] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.319892] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.319892] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.320920] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.321651] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.322770] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.323273] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.324456] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.324876] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.325307] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.325735] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.326022] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.326450] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.327665] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.327665] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1641.328192] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.328804] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.329493] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.329939] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1651.330657] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.330967] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.331913] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1656.332315] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1661.333539] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.333539] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.334622] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.335122] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.336335] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.336720] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.787537] env[65469]: INFO networking_nsxv3.common.synchronization [req-c601535c-ed4c-4ac4-9875-026c8ccac783 req-04eb4076-71d8-42f7-9632-7edb8263d34f tempest-AttachVolumeTestJSON-2015146677 tempest-AttachVolumeTestJSON-2015146677-project-member] Enqueued Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1671.787818] env[65469]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12695f-3c23-4690-aae0-abd23780e464 with Priority: HIGHEST for action security_group_members [ 1671.788115] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a12695f-3c23-4690-aae0-abd23780e464 taken with stack trace [, , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.788307] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.788430] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.788901] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.788901] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.789204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.789204] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.789436] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.790260] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.790260] env[65469]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a12695f-3c23-4690-aae0-abd23780e464',) {} {{(pid=65469) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.292466] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.292699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.292699] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.292918] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.293017] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.293222] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.293321] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.293381] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.293538] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.293615] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.293702] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 is going to be updated. [ 1672.330020] env[65469]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65469) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.330255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.330255] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.330462] env[65469]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.330604] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.338665] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: IN_PROGRESS for 2s [ 1674.350550] env[65469]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a12695f-3c23-4690-aae0-abd23780e464 in Status: SUCCESS [ 1674.350952] env[65469]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a12695f-3c23-4690-aae0-abd23780e464 deletion is rescheduled due to dependency. [ 1674.350952] env[65469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a12695f-3c23-4690-aae0-abd23780e464" {{(pid=65469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.788666] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1676.789094] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1681.790080] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1681.790506] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1686.791760] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1686.792172] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1691.793332] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.793729] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1696.794534] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.794948] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.795467] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.795867] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.796869] env[65469]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.797250] env[65469]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0